-- Logs begin at Thu 2022-06-23 21:36:18 UTC, end at Thu 2022-06-23 23:07:19 UTC. -- Jun 23 22:36:13.073499 dv-cinder-813229-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 22:36:13.081574 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 22:36:13 2022] *** Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: nodename: dv-cinder-813229-11-iscsi Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: machine: x86_64 Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: clock source: unix Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: pcre jit disabled Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: detected number of CPU cores: 4 Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: current working directory: / Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: detected binary path: /usr/bin/uwsgi-core Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: your processes number limit is 47680 Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: your memory page size is 4096 bytes Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: detected max file descriptor number: 2048 Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: lock engine: pthread robust mutexes Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: thunder lock: enabled Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 22:36:13.084697 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 22:36:13.127428 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: Python main interpreter initialized at 0x55f0fcc369c0 Jun 23 22:36:13.127428 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: python threads support enabled Jun 23 22:36:13.127428 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: your server socket listen backlog is limited to 100 connections Jun 23 22:36:13.127428 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: your mercy for graceful operations on workers is 90 seconds Jun 23 22:36:13.127806 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 22:36:13.127883 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: *** Operational MODE: preforking *** Jun 23 22:36:13.128099 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: *** uWSGI is running in multiple interpreter mode *** Jun 23 22:36:13.128099 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: spawned uWSGI master process (pid: 110175) Jun 23 22:36:13.128315 dv-cinder-813229-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 22:36:13.129174 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: spawned uWSGI worker 1 (pid: 110176, cores: 1) Jun 23 22:36:13.129282 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: spawned uWSGI worker 2 (pid: 110177, cores: 1) Jun 23 22:36:13.129638 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 22:36:13.799591 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 22:36:13.802536 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 22:36:14.936673 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:36:14.936673 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: from cryptography.utils import int_from_bytes Jun 23 22:36:14.937286 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:36:14.937286 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: from cryptography.utils import int_from_bytes Jun 23 22:36:14.937747 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:36:14.937747 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: from cryptography.utils import int_from_bytes Jun 23 22:36:14.937860 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:36:14.937860 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: from cryptography.utils import int_from_bytes Jun 23 22:36:17.419591 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 22:36:17.420142 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 22:36:17.420226 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 22:36:17.420555 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 22:36:17.420658 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 22:36:17.420726 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 22:36:17.420986 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 22:36:17.421089 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 22:36:17.421369 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 22:36:17.421515 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.421610 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 22:36:17.421705 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.421995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.422099 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.422312 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.422408 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.422628 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.422727 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.422942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.423034 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.423263 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.423355 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.423568 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.423654 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.423888 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.423980 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.424148 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.424241 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.424465 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.424558 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.424784 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.424869 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-11-iscsi {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.425100 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.425185 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.425423 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-11-iscsi {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.425510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.425731 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.425816 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.426033 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.426132 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.426337 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.426421 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.426648 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.426734 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.426949 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.427043 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.427267 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.427444 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.427570 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.428599 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.428740 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.428883 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.428965 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429135 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429214 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429354 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429439 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429517 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429643 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429731 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429811 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.429947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.430034 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.430270 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.430356 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.430577 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.430671 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.430900 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.431023 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-11-iscsi {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.431208 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.431379 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.431612 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-11-iscsi {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.431698 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.431924 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.432018 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.432241 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.432329 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.432553 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.432694 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.432957 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.433043 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.433278 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.433408 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.433584 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.433679 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.433901 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.433987 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.434218 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.434304 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.434533 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.434627 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.434850 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.434982 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.435195 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.435340 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.435504 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.435655 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.435813 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.435911 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.436078 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.436165 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.436390 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.436476 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.436717 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.436807 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.437022 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.437117 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.437274 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.437361 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.437583 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.437668 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.437844 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.437939 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.438150 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.438243 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.438468 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.438558 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.438768 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.438866 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.439019 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.439107 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.439334 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.439419 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.439582 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.439669 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.439898 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.439985 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.440217 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.440303 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.440524 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.440638 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.440856 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.440952 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.441163 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.441264 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.441468 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.441553 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.441772 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.441857 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.442079 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.442172 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.442382 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.442473 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.442687 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.442772 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.443003 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.443103 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.443310 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.443402 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.443628 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.443713 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.443935 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.444032 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.444263 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.444356 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.444588 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.444791 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.444930 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.445027 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.445252 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.445339 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.445560 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.445665 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.445878 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.445986 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.446201 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.446298 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.446509 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.446595 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.446816 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.446911 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.447122 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.447215 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.447441 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.447527 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.447776 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.447870 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.448084 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.448170 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.448334 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.448456 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.448652 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.448755 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.448958 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.449044 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.449254 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.449349 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.449557 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.449643 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.449859 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.449943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.450163 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.450258 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.450464 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.450549 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.451311 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.451479 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.451662 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.451828 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.452040 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.452257 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.452345 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.452673 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.452761 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.452985 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.453229 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.453318 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.453588 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.453674 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.453894 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.453981 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.454202 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.454286 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.454513 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.454600 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.454817 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.454906 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.455119 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.455205 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.455425 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.455531 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.455729 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.455823 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.456039 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.456124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.456343 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.456429 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.456670 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.456762 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.456978 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.457074 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.457285 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.457379 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.457590 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.457675 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.457893 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.457979 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.458205 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.458301 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.458507 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.458596 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.458810 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.458896 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.459109 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.459194 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.459415 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.459508 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.459717 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.459802 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.460030 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.460120 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.460326 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.460412 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.460647 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.460746 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.460956 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.461050 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.461258 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.461351 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.461559 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.461643 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.461857 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.461989 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.462160 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.462245 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.462457 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.462543 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.462758 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.462852 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.463058 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.463153 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.463359 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.463446 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.463656 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.463750 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.463959 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.464053 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.464278 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.464364 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.464637 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.464728 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.464909 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.464996 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.465212 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.465300 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.465530 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:36:17.465626 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.465864 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.465951 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.466195 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.466954 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.467120 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.467273 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.467410 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.467505 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.467716 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.467814 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.468048 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.468141 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.468362 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.468534 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.468733 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.468859 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.469004 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.469120 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.469325 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.469440 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.469646 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.469801 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.469953 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.470040 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.470267 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.470392 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.470583 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.470707 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.470902 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.471025 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.471213 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.471328 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.471534 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.471666 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.471864 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.471963 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.472187 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.472291 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.472498 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.472614 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.472843 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.472927 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.473172 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.473256 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.473493 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.473591 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.473805 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.473889 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.474126 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.474210 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.474438 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.474524 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.474747 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.474831 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.475057 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.475140 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.475378 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.475463 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.475688 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.475771 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.475997 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.476082 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.476304 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.476389 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.476631 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.476722 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.476947 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.477033 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.477257 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.477342 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.477567 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.477652 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.477879 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.477983 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.478189 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.478274 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.478513 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.478596 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.478809 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.478911 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.479117 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.479202 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.479433 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.479516 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.479748 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.479916 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.480063 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.480156 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.480371 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.480454 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.480696 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.480809 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.481004 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.481089 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.481309 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.481401 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.481619 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.481718 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.481962 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.482218 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.482435 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.482666 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.482835 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.482985 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.483123 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.483257 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.483398 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.483533 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.483689 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.483826 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.483969 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.484110 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.484254 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.484401 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.484542 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.484738 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.484916 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.485112 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.485253 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.485395 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.485539 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.485683 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.485817 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.485950 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.486087 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.486229 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.486371 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.486524 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.486657 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.486790 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.486923 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.487063 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.487202 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.487372 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.487519 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.487688 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.487824 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.488006 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.488143 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.488318 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.488454 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.488651 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.488742 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.488964 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.489064 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.489275 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.489362 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.489585 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.489684 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.489895 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.489989 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.490203 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.490290 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.490510 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.490605 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.490829 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.490916 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.491140 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.491233 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.491450 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.491545 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.491765 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.491850 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.492071 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.492165 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.492382 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.492486 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.492708 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.492801 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.493012 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.493110 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.493316 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.493409 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.493624 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.493750 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.493932 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.494021 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.494236 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.494331 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.494537 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.494624 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.494838 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.494932 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.495141 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.495235 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.495440 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.495526 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.495742 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.495836 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.496045 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.496132 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.496344 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.496438 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.496666 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.496769 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.496986 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.497073 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.497291 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.497378 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.497777 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.497945 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.498164 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.498325 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.498483 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.498578 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.498827 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.498928 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.499134 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.499234 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.499473 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.499561 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.499794 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.499889 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.500110 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.500197 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.500425 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.500518 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.500763 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.500853 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.501085 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.501242 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.501392 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.501480 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.501700 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.501788 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.502011 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.502097 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.502317 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.502402 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.502635 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.502721 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.502944 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.503029 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.503246 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.503330 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.503557 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.503643 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.503882 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.503990 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.504192 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.504300 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.504508 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.504614 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.504835 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.504917 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.505149 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.505258 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.505461 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.505545 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.505772 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.505856 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.506085 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.506178 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.506396 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.506489 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.506702 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.506791 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.507013 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.507111 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.507321 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.507406 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.507630 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.507714 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.507935 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.508032 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.508246 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.508342 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.508552 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.508672 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.508882 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.508965 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.509186 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.509278 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.509492 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.509575 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.509811 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.509896 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.510120 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.510213 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.510435 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.510519 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.510735 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.510819 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.511046 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.511130 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.511354 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.511437 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.511665 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.511749 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.511974 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.512058 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.512280 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.512374 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.512598 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.512686 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.512913 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.512997 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.513762 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.513865 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.514075 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.514155 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.514381 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.514475 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.514682 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.514776 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.514989 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.515073 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.515299 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.515382 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.515603 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.515695 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.515904 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.515987 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.516203 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.516287 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.516515 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.516620 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.516846 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.516931 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.517151 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.517237 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.517453 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.517539 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.517762 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.517846 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.518068 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.518151 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.518383 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.518478 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.518691 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.518783 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.519000 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.519085 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.519299 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.519384 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.519604 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.519697 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.519921 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.520013 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.520228 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.520313 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.520817 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.520913 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.521119 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.521211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.521422 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.521507 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.521743 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.521827 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.522057 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.522149 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.522363 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.522447 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.522670 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.522753 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.522987 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.523079 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.523294 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.523379 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.523602 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.523685 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.523909 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.524001 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.524218 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.524301 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.524530 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.524640 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.524866 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.524960 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.525174 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.525264 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.525482 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.525566 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.525791 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.525877 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.526099 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.526182 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.526405 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.526496 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.526715 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.526805 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.527020 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.527104 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.527330 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.527592 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.527677 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.527930 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.528014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.528241 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.528333 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.528558 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.528666 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.529588 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.529739 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.529913 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.530046 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.530248 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.530367 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.530581 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.530691 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.530926 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.531019 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.531236 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.531330 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.531550 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.531634 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.531858 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.531962 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.532165 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.532297 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.532481 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.532636 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.532817 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.532936 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.533122 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.533245 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.533427 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.533551 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.533737 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.533863 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.534042 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.534168 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.534355 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.534473 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.534638 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.534776 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.534944 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.535085 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.535260 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.535386 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.535564 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.535689 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.535876 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.535993 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.536179 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.536295 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.536498 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.536628 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.536830 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.536932 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.537135 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.537221 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.537486 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.537588 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.537743 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.537839 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.538087 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.538181 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.538396 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.538499 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.538700 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.538812 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.538999 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.539086 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.539343 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.539431 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.539648 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.539745 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.539955 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.540041 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.540277 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.540364 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.540606 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.540697 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.540908 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.541007 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.541215 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.541302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.541523 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.541612 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.541828 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.541914 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.542130 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.542224 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.542437 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.542531 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.542743 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.542850 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.543051 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.543157 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.543350 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.543437 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.543652 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.543739 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.543957 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.544054 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.544258 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.544373 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.544610 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.544766 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.544922 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.545100 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.545193 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.545282 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.545487 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.545585 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.545796 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.545884 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.546103 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.546190 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.546403 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.546496 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.546705 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.546799 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.547004 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.547090 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.547308 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.547394 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.547609 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.547697 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.547915 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.548003 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.548214 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.548300 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.548524 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.548632 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.548853 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.548951 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.549150 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.549249 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.549448 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.549594 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.549755 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.549846 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.550056 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.550156 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.550353 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.550439 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.550657 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.550749 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.550958 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.551054 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.551257 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.551356 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.551558 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.551645 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.551863 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.551962 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.552165 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.552253 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.552467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.552552 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.552794 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.552882 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.553100 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.553222 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.553404 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.553510 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.553705 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.553802 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.554010 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.554110 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.554310 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.554411 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.554611 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.554754 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.554911 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.555008 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.555214 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.555307 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.555516 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.555604 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.555817 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.555904 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.556120 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.556216 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.556423 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.556510 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.556746 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.556834 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.557050 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.557147 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.557362 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.557448 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.557667 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.557754 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.557968 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.558064 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.558269 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.558363 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.558610 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.558697 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.558914 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.559031 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.559224 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.559317 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.559535 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.559638 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.559848 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.559943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.560177 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.560277 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.560486 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.560599 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.560820 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.560913 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.561130 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.561213 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.561432 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.561516 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.561737 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.561822 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.562044 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.562127 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.562354 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.562437 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.562656 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.562749 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.562962 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.563047 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.563281 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.563364 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.563589 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.563674 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.563893 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.563977 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.564202 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.564296 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.564512 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.564641 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.564882 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.564984 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.565184 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.565278 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.565491 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.565583 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.565801 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.565884 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.566107 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.566203 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.566417 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.566500 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.566723 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.566806 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.567031 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.567125 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.567334 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.567425 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.567641 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.567725 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.567946 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.568030 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.568250 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.568341 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.568553 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.568707 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.568885 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.568973 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.569188 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.569282 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.569500 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.569585 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.569808 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.569937 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.570120 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.570212 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.570426 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.570511 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.570733 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.570850 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.571069 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.571156 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.571379 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.571473 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.571681 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.571765 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.572048 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.572139 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.572359 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.572456 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.572697 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.572798 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.573011 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.573104 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.573316 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.573409 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.573623 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.573734 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.573936 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.574048 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.574251 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.574365 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.574554 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.574677 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.574972 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.575076 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.575274 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.575364 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.576106 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.576246 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.576452 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.576600 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.576993 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.577078 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.577303 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.577395 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.577617 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.577707 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.577940 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.578033 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.578243 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.578328 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.578548 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.578640 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.578853 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.578970 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.579171 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.579286 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.579475 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.579593 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.579795 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.580007 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.580211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.580318 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.580522 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.580640 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.580849 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.580964 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.581259 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.581344 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.581567 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.581661 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.581887 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.581970 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.582200 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.582285 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.582510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.582620 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.582833 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.582927 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.583133 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.583223 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.583445 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.583529 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.583754 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.583846 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.584056 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.584139 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.584377 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.584463 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.584708 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.584798 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.585026 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.585146 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.585332 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.585451 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.585654 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.585754 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.585974 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.586071 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.586290 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.586386 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.586611 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.586709 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.586965 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.587068 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.587274 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.587371 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.587581 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.587677 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.587891 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.587989 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.588199 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.588304 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.588504 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.588626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.588850 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.588947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.589160 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.589278 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.589466 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.589563 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.589769 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.589857 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.590078 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.590195 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.590384 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.590477 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.590689 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.590774 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.590998 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.591091 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.591843 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.592021 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.592157 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.592459 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.592569 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.592822 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.592922 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.593128 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.593216 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.593451 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.593568 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.593770 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.593866 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.594092 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.594180 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.594403 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.594504 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.594708 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.594794 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.595012 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.595105 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.595320 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.595424 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.595624 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.595711 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.595928 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.596014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.596234 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.596322 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.596590 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.596680 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.596896 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.596995 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.597217 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.597306 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.597546 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.597634 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.597872 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.597960 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.598182 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.598271 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.598515 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.598603 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.598839 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.598925 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.599143 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.599230 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.599453 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.599541 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.599765 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.599861 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.600072 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.600224 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.600369 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.600464 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.600694 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.600800 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.600999 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.601087 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.601301 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.601388 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.601602 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.601698 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.601904 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.601991 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.602204 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.602290 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.602511 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.602607 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.602813 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.602900 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.603125 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.603212 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.603426 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.603515 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.603727 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.603814 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.604031 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.604120 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.604334 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.604421 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.604656 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.604746 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.604962 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.605048 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.605303 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.605415 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.605602 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.605692 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.605929 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.606043 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.606238 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.606327 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.606556 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.606650 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.606911 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.607084 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.607229 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.607383 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.607540 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.607675 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.607824 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.607989 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.608140 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.608304 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.608456 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.608639 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.608792 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.608958 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.609107 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.609266 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.609421 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.609586 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.609737 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.609900 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.610046 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.610215 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.610349 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.610659 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.610821 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.610973 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.611062 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.611351 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.611490 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.611663 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.611816 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.611977 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.612127 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.612292 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.612444 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.612635 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.612776 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.612951 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.613088 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.613260 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.613399 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.613569 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.613710 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.613878 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.614019 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.614206 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.614326 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.614528 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.614637 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.614852 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.614964 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.615187 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.615294 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.615503 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.615595 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.615816 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.615904 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.616131 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.616228 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.616445 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.616533 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.616822 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.616914 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.617138 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.617240 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.617446 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.617534 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.617761 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.617849 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.618076 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.618167 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.618387 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.618473 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.618697 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.618785 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.619010 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.619098 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.619322 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.619417 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.619632 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.619727 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.619940 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.620028 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.620248 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.620342 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.620557 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.620679 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.620882 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.620974 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.621193 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.621283 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.621503 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.621600 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.621826 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.621921 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.622138 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.622225 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.622484 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.622622 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.622783 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.622931 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.623084 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.623319 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.623425 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.623636 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.623898 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.623985 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.624211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.624298 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.624542 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.624652 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.624888 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.624976 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.625210 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.625298 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.625529 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.625619 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.625834 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.625921 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.626140 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.626227 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.626451 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.626538 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.626755 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.626842 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.627058 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.627154 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.627362 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.627455 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.627665 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.627760 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.627968 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.628063 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.628280 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.628366 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.628600 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.628691 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.628925 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.629138 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.629233 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.629496 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.629753 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.629848 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.630103 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.630200 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.630422 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.630550 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.630748 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.630836 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.631056 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.631144 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.631377 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.631464 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.631683 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.631777 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.631990 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.632092 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.632299 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.632385 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.632624 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.632727 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.632932 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.633026 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.633237 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.633325 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.633538 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.633630 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.633841 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.633938 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.634144 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.634239 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.634448 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.634548 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.634751 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.634845 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.635056 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.635143 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.635361 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.635457 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.635664 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.635766 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.635970 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.636067 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.636271 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.636371 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.636613 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.636703 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.636896 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.636983 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.637198 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.637296 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.637497 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.637584 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.637798 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.637885 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.638661 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.638824 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.638966 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.639118 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.639275 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.639405 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.639566 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.639655 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.639874 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.639962 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.640180 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.640276 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.640515 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.640622 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.640865 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.640963 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.641167 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.641267 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.641471 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.641559 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.641785 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.641880 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.642095 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.642192 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.642406 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.642493 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.642717 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.642805 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.643025 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.643120 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.643347 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.643434 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.643660 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.643748 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.644007 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.644191 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.644326 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.644523 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.644872 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.644961 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.645206 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.645305 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.645794 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.645890 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.646100 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.646192 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.646405 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.646495 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.646710 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.646805 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.647034 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.647119 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.647339 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.647427 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.647647 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.647734 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.647959 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.648051 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.648268 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.648364 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.648594 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.648686 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.648904 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.649005 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.649213 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.649311 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.649519 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.649654 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.649829 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.649973 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.650135 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.650222 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.650440 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.650526 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.650746 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.650841 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.651051 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.651137 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.651358 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.651446 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.651666 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.651764 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.651982 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.652076 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.652305 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.652392 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.652647 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.652741 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.652965 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.653091 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.653276 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.653372 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.653587 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.653678 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.654448 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.654595 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.654745 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.654901 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.655024 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.655110 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.655320 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.655444 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.655634 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.655760 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.655961 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.656050 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.656275 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.656469 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.656595 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.656807 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.657012 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.657127 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.657323 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.657449 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.657642 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.657760 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.657963 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.658081 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.658274 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.658404 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.658596 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.658719 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.658915 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.659042 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.659227 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.659355 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.659546 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.659685 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.659857 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.660028 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.660182 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.660358 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.660516 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.660706 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.660880 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.661016 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.661204 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.661324 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.661509 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.661630 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.661814 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.661941 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.662118 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.662261 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.662426 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.662572 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.662745 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.662878 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.663060 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.663183 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.663365 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.663493 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.663670 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.663800 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.663977 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.664103 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.664281 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.664464 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.664619 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.664724 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.664908 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.665030 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.665210 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.665333 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.665520 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.665638 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.665822 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.665954 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.666126 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.666220 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.666430 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.666518 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.666732 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.666826 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.667034 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.667121 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.667336 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.667433 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.667644 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.667739 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.667947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.668035 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.668250 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.668345 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.668553 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.668703 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.668879 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.668967 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.669180 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.669281 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.669572 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.669738 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.669889 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.669992 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.670202 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.670302 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.670523 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.670612 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.670831 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.670917 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.671147 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.671234 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.671454 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.671542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.671768 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.671863 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.672078 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.672167 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.672390 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.672484 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.672725 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.672819 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.673039 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.673127 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.673350 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.673437 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.673660 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.673760 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.673967 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.674061 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.674274 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.674362 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.674586 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.674699 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.674893 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.674982 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.675202 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.675288 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.675526 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.675622 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.675829 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.675923 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.676152 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.676241 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.676466 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.676566 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.676800 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.676887 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.677113 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.677200 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.677424 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.677514 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.677732 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.677819 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.678046 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.678139 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.678353 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.678442 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.678662 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.678749 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.678969 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.679056 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.679279 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.679367 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.679594 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.679689 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.679907 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.680002 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.680218 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.680304 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.680540 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.680661 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.680869 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.680975 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.681192 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.681280 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.681515 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.681603 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.681856 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.681952 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.682166 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.682253 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.682487 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.682574 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.682800 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.682902 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.683108 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.683198 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.683353 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 22:36:17.683448 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.683720 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:36:17.683962 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 22:36:17.837852 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO dbcounter [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Registered counter for database nova_api Jun 23 22:36:17.838832 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO dbcounter [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Registered counter for database nova_api Jun 23 22:36:17.858996 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_db.sqlalchemy.engines [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:36:17.861115 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG oslo_db.sqlalchemy.engines [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:36:17.865593 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writer thread running {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:36:17.867517 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writer thread running {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:36:17.923264 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.context [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f0b80a3-fbde-406f-b6e6-3de0c437540c(cell1) {{(pid=110177) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 22:36:17.924512 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.context [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f0b80a3-fbde-406f-b6e6-3de0c437540c(cell1) {{(pid=110176) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 22:36:17.927212 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:17.928410 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG oslo_concurrency.lockutils [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:17.928810 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.929600 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:17.930099 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG oslo_concurrency.lockutils [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.930933 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG oslo_concurrency.lockutils [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:36:17.931531 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.932887 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG oslo_concurrency.lockutils [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110176) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:36:17.933546 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO dbcounter [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Registered counter for database nova_cell0 Jun 23 22:36:17.934836 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO dbcounter [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Registered counter for database nova_cell0 Jun 23 22:36:17.938403 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO dbcounter [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Registered counter for database nova_cell1 Jun 23 22:36:17.939329 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO dbcounter [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Registered counter for database nova_cell1 Jun 23 22:36:17.946201 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_db.sqlalchemy.engines [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:36:17.949859 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG oslo_db.sqlalchemy.engines [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:36:17.950049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_db.sqlalchemy.engines [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:36:17.952096 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG oslo_db.sqlalchemy.engines [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:36:17.954761 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writer thread running {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:36:17.957076 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writer thread running {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:36:17.959850 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writer thread running {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:36:18.093358 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writer thread running {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:36:18.103004 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO dbcounter [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Registered counter for database nova_cell0 Jun 23 22:36:18.104521 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO dbcounter [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Registered counter for database nova_cell0 Jun 23 22:36:18.110468 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_db.sqlalchemy.engines [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:36:18.113999 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG oslo_db.sqlalchemy.engines [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:36:18.114748 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writer thread running {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:36:18.118275 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writer thread running {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:36:18.522474 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: WARNING keystonemiddleware.auth_token [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:36:18.530327 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: WARNING keystonemiddleware.auth_token [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:36:18.532212 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: WARNING keystonemiddleware.auth_token [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:36:18.539384 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: WARNING keystonemiddleware.auth_token [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:36:18.873761 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: WARNING keystonemiddleware.auth_token [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:36:18.879613 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: WARNING keystonemiddleware.auth_token [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:36:18.881909 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: WARNING keystonemiddleware.auth_token [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:36:18.884922 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f0fcc369c0 pid: 110177 (default app) Jun 23 22:36:18.886987 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:36:18.887781 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: WARNING keystonemiddleware.auth_token [None req-f741a815-cbc8-4715-9c9c-cf898043ada3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:36:18.888754 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Jun 23 22:36:18.889166 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Thu Jun 23 22:36:18 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:36:18.893732 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f0fcc369c0 pid: 110176 (default app) Jun 23 22:37:36.497009 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:36.498629 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Jun 23 22:37:36.499016 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:36.511757 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writing DB stats nova_api:SELECT=3 {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:36.512924 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writing DB stats nova_cell1:SELECT=3 {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:36.513950 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writing DB stats nova_cell0:SELECT=3 {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:36.515003 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:36.945940 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-73ec1de5-2c80-412d-845a-ed5cc93e1e54 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:36.974468 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-73ec1de5-2c80-412d-845a-ed5cc93e1e54 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.468446 Jun 23 22:37:36.975320 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 23 22:37:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:39.064984 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:39.066839 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-170f9f1b-9c0d-47fb-86af-aeb0862d0b03 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002379 Jun 23 22:37:39.067719 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:39.136689 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-84d572e6-2b3c-4274-a9a5-175cf6e125f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1", "name": "cirros256", "disk": 1, "rxtx_factor": 1.0}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:39.155729 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:37:39.155729 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: warnings.warn(msg) Jun 23 22:37:39.255148 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-84d572e6-2b3c-4274-a9a5-175cf6e125f9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.181162 Jun 23 22:37:39.260791 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:37:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:37:39.278470 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_api:SELECT=3 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:39.279653 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_cell1:SELECT=3 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:39.281148 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_cell0:SELECT=3 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:39.282882 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:37:39.491427 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-4e30392b-17c1-4814-9fb6-812484c3c6a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:39.493878 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:37:39.493878 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: warnings.warn(msg) Jun 23 22:37:39.639962 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-4e30392b-17c1-4814-9fb6-812484c3c6a6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.373284 Jun 23 22:37:39.639962 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 22:37:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:41.759932 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-84d572e6-2b3c-4274-a9a5-175cf6e125f9 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:41.761157 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-84d572e6-2b3c-4274-a9a5-175cf6e125f9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Jun 23 22:37:41.761635 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:41.869494 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-9379c009-5a85-4be6-bc81-d4db89f5ccea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:41.887810 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:37:41.887810 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: warnings.warn(msg) Jun 23 22:37:41.953064 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-9379c009-5a85-4be6-bc81-d4db89f5ccea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.185192 Jun 23 22:37:41.953643 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:37:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:37:41.966948 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-88639ac4-0a9d-4389-a849-7b2e0f39ee04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:41.968729 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:37:41.968729 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: warnings.warn(msg) Jun 23 22:37:42.070368 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-88639ac4-0a9d-4389-a849-7b2e0f39ee04 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107747 Jun 23 22:37:42.070869 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 22:37:41 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:37:44.171169 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-9379c009-5a85-4be6-bc81-d4db89f5ccea admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:44.172193 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-9379c009-5a85-4be6-bc81-d4db89f5ccea admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 23 22:37:44.172787 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:44.232426 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-81e72d37-e9ac-4aa4-82db-1533fe153247 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:44.333656 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-81e72d37-e9ac-4aa4-82db-1533fe153247 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155330 Jun 23 22:37:44.341136 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:37:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:37:44.346168 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-317d1d9f-381f-4432-9743-dcbe5e5ec4bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:44.425340 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-317d1d9f-381f-4432-9743-dcbe5e5ec4bd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082716 Jun 23 22:37:44.426038 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 22:37:44 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:46.530268 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-81e72d37-e9ac-4aa4-82db-1533fe153247 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:46.531296 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-81e72d37-e9ac-4aa4-82db-1533fe153247 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 23 22:37:46.531847 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:46.590319 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-374f18d1-ef87-4f26-a0cf-f8834dcc7da2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "id": "d3", "rxtx_factor": 1.0}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:46.671170 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-374f18d1-ef87-4f26-a0cf-f8834dcc7da2 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132736 Jun 23 22:37:46.671170 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:37:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:37:46.683190 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-33e2d2e1-9d2b-4de6-af15-6477be871dde admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:46.775465 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-33e2d2e1-9d2b-4de6-af15-6477be871dde admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096484 Jun 23 22:37:46.776236 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 22:37:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:48.937217 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-374f18d1-ef87-4f26-a0cf-f8834dcc7da2 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:48.938224 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-374f18d1-ef87-4f26-a0cf-f8834dcc7da2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 23 22:37:48.939189 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:49.017774 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-8f782572-4272-4358-8f2b-a72a3a5de0a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "name": "ds4G", "swap": 0, "vcpus": 4}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:49.095711 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-8f782572-4272-4358-8f2b-a72a3a5de0a0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150216 Jun 23 22:37:49.096513 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:37:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:37:49.109693 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-be66c534-cd6e-4e34-9049-732a682a1867 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:49.218782 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-be66c534-cd6e-4e34-9049-732a682a1867 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114007 Jun 23 22:37:49.219472 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Thu Jun 23 22:37:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:51.330301 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-8f782572-4272-4358-8f2b-a72a3a5de0a0 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:51.331434 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-8f782572-4272-4358-8f2b-a72a3a5de0a0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jun 23 22:37:51.331943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:51.394882 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-2e59d9d4-f46d-43e2-b9c0-e3e7d40d1e96 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:51.417831 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-2e59d9d4-f46d-43e2-b9c0-e3e7d40d1e96 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079531 Jun 23 22:37:51.418371 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 23 22:37:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:37:53.522006 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-8f782572-4272-4358-8f2b-a72a3a5de0a0 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:53.523067 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-8f782572-4272-4358-8f2b-a72a3a5de0a0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Jun 23 22:37:53.523483 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:53.585325 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-fcc906f0-c255-49b3-96e5-b64578004cae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:53.663974 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-fcc906f0-c255-49b3-96e5-b64578004cae admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.133760 Jun 23 22:37:53.664519 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:37:53 2022] POST /compute/v2.1/flavors => generated 402 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:37:53.676990 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-ff5fa6f1-4991-4280-902d-0851c3e13d28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:53.758422 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-ff5fa6f1-4991-4280-902d-0851c3e13d28 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085160 Jun 23 22:37:53.762322 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 22:37:53 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:55.891104 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-fcc906f0-c255-49b3-96e5-b64578004cae admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:55.892423 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-fcc906f0-c255-49b3-96e5-b64578004cae admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001755 Jun 23 22:37:55.892872 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:55.962405 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-a3dfa789-ea64-4838-8636-f24c4650d422 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:56.171269 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-a3dfa789-ea64-4838-8636-f24c4650d422 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.272407 Jun 23 22:37:56.171975 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:37:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:37:56.185969 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-568abbc6-a2cb-4583-b534-3f0c4f516859 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:56.272414 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-568abbc6-a2cb-4583-b534-3f0c4f516859 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091781 Jun 23 22:37:56.280142 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 22:37:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:37:58.328156 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-a3dfa789-ea64-4838-8636-f24c4650d422 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:37:58.329529 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-a3dfa789-ea64-4838-8636-f24c4650d422 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Jun 23 22:37:58.330087 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:37:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:37:58.390154 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-351c9cc6-fc4b-4945-9ec2-eddfb59c7e17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "id": "3"}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:58.463497 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-351c9cc6-fc4b-4945-9ec2-eddfb59c7e17 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.127552 Jun 23 22:37:58.464060 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:37:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:37:58.477634 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-c528284a-056e-426d-a89b-72338586fb0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:37:58.566554 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-c528284a-056e-426d-a89b-72338586fb0c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093647 Jun 23 22:37:58.567266 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 22:37:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:38:00.637492 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-351c9cc6-fc4b-4945-9ec2-eddfb59c7e17 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:00.638509 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-351c9cc6-fc4b-4945-9ec2-eddfb59c7e17 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 23 22:38:00.638909 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:38:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:00.697394 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-deca1ce3-417b-4bc2-82dd-9b91a956959c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "4", "disk": 80, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:00.797565 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-deca1ce3-417b-4bc2-82dd-9b91a956959c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.152564 Jun 23 22:38:00.798202 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:38:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:38:00.810346 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-2e547cbe-c2b2-40a7-8659-917564ce5686 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:00.886792 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-2e547cbe-c2b2-40a7-8659-917564ce5686 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080279 Jun 23 22:38:00.891585 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 22:38:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:02.960309 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-deca1ce3-417b-4bc2-82dd-9b91a956959c admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:02.961376 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-deca1ce3-417b-4bc2-82dd-9b91a956959c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jun 23 22:38:02.961775 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:38:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:38:03.027564 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-9cb5374a-4fe9-472a-b049-5a4b7f1676c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "swap": 0, "disk": 160}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:03.105938 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-9cb5374a-4fe9-472a-b049-5a4b7f1676c4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.137630 Jun 23 22:38:03.107101 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Thu Jun 23 22:38:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:38:03.129231 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-9d88aab2-edf9-4df8-8f58-e324511543c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:03.212770 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-9d88aab2-edf9-4df8-8f58-e324511543c1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092687 Jun 23 22:38:03.213658 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Thu Jun 23 22:38:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:38:28.455394 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-9cb5374a-4fe9-472a-b049-5a4b7f1676c4 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:28.456413 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-9cb5374a-4fe9-472a-b049-5a4b7f1676c4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 23 22:38:28.456858 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:38:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:28.467958 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:28.517367 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-5f215786-b63a-45eb-8aa2-ce85efadc1a9 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:28.534618 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-5f215786-b63a-45eb-8aa2-ce85efadc1a9 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071166 Jun 23 22:38:28.535150 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 23 22:38:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:38:29.449590 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-9cb5374a-4fe9-472a-b049-5a4b7f1676c4 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:29.450605 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-9cb5374a-4fe9-472a-b049-5a4b7f1676c4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 23 22:38:29.451005 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:29.637967 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-33dadb8b-2115-4fe4-a6ae-90d048911f14 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:29.643731 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.wsgi [None req-33dadb8b-2115-4fe4-a6ae-90d048911f14 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-33dadb8b-2115-4fe4-a6ae-90d048911f14 admin admin] Request method failure captured: Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Accept: application/json Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Accept-Encoding: gzip, deflate Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Connection: keep-alive Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Content-Length: 0 Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Host: 10.222.0.33 Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Openstack-Api-Version: compute 2.90 Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Openstack-System-Scope: None Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: User-Agent: python-novaclient Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Auth-Token: gAAAAABitOtlZPmidZETpS6IOCV8AEs0kiJmz-Lb1wlT6I0NIpD6VTLXV7J-H5QzXHXDYHdkozffmatcIZyZV91i-D3zHq5X_kPcrKqiH3W2V8vNQhkKLaZbS91E3YvKS1aXIrAerc3h5Lbop1kYa0uJGCDQDrInW7Ej3TU-MyfamXoHrlhABB0 Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Domain-Id: None Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Domain-Name: None Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Identity-Status: Confirmed Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Is-Admin-Project: True Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Domain-Id: default Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Domain-Name: Default Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Name: admin Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Role: reader,member,admin Jun 23 22:38:29.646995 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Roles: reader,member,admin Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0d9b0cc6e44015a1eedda4627f582b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant: admin Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant-Name: admin Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User: admin Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Domain-Id: default Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Domain-Name: Default Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Id: 091e3a1287aa48ddab1a4bfa5166599f Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Name: admin Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: method: > Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: exception: Flavor 42 could not be found. Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: action_args: {'id': '42'} Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:29.649340 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:29.650597 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.651947 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-33dadb8b-2115-4fe4-a6ae-90d048911f14 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:29.653368 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-33dadb8b-2115-4fe4-a6ae-90d048911f14 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061598 Jun 23 22:38:29.653368 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 23 22:38:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:38:29.658633 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-9ce845fc-d1ad-4b15-a27f-cec357397b99 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:29.661617 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:38:29.681881 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-9ce845fc-d1ad-4b15-a27f-cec357397b99 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026841 Jun 23 22:38:29.682423 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 22:38:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:38:29.691824 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-3d8d5523-29a9-4bd9-905e-20e6c5978a3c admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:29.714439 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-3d8d5523-29a9-4bd9-905e-20e6c5978a3c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026106 Jun 23 22:38:29.714968 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 22:38:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:38:29.723999 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-570105f1-d7f2-4402-b379-a75f49732086 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:29.730793 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.wsgi [None req-570105f1-d7f2-4402-b379-a75f49732086 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-570105f1-d7f2-4402-b379-a75f49732086 admin admin] Request method failure captured: Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Accept: application/json Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Accept-Encoding: gzip, deflate Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Connection: keep-alive Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Content-Length: 0 Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Host: 10.222.0.33 Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Openstack-Api-Version: compute 2.90 Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Openstack-System-Scope: None Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: User-Agent: python-novaclient Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Auth-Token: gAAAAABitOtlZPmidZETpS6IOCV8AEs0kiJmz-Lb1wlT6I0NIpD6VTLXV7J-H5QzXHXDYHdkozffmatcIZyZV91i-D3zHq5X_kPcrKqiH3W2V8vNQhkKLaZbS91E3YvKS1aXIrAerc3h5Lbop1kYa0uJGCDQDrInW7Ej3TU-MyfamXoHrlhABB0 Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Domain-Id: None Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Domain-Name: None Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Identity-Status: Confirmed Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Is-Admin-Project: True Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Domain-Id: default Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Domain-Name: Default Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Name: admin Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Role: reader,member,admin Jun 23 22:38:29.734124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Roles: reader,member,admin Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0d9b0cc6e44015a1eedda4627f582b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant: admin Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant-Name: admin Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User: admin Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Domain-Id: default Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Domain-Name: Default Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Id: 091e3a1287aa48ddab1a4bfa5166599f Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Name: admin Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: method: > Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: exception: Flavor 42 could not be found. Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: action_args: {'id': '42'} Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:29.735610 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:29.736467 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:29.739136 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-570105f1-d7f2-4402-b379-a75f49732086 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:29.740127 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-570105f1-d7f2-4402-b379-a75f49732086 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015059 Jun 23 22:38:29.740127 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 23 22:38:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:38:30.555304 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-3d8d5523-29a9-4bd9-905e-20e6c5978a3c admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:30.556315 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-3d8d5523-29a9-4bd9-905e-20e6c5978a3c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 23 22:38:30.556746 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:30.744684 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-0d6105e4-7757-4e52-a270-7df9f5698810 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:30.751959 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.wsgi [None req-0d6105e4-7757-4e52-a270-7df9f5698810 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-0d6105e4-7757-4e52-a270-7df9f5698810 admin admin] Request method failure captured: Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Accept: application/json Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Accept-Encoding: gzip, deflate Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Connection: keep-alive Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Content-Length: 0 Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Host: 10.222.0.33 Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Openstack-Api-Version: compute 2.90 Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Openstack-System-Scope: None Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: User-Agent: python-novaclient Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Auth-Token: gAAAAABitOtmXpe7da_pYtv3C-9w9aEbcle4jYZ1EjfQF9L9kb2KFfs2q3WLCF6bSLeWClKabs9KnxrJ-L42qx945U3sb-Sv7iPr5dfrA3Av_9bSsylsqC-5688APXmHQuLCQoOdiDPonSSQxz9mvcDg-q56au-jJONOLbbvsklhdtCXOKHTTTg Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Domain-Id: None Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Domain-Name: None Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Identity-Status: Confirmed Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Is-Admin-Project: True Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Domain-Id: default Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Domain-Name: Default Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Name: admin Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Role: reader,member,admin Jun 23 22:38:30.753510 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Roles: reader,member,admin Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0d9b0cc6e44015a1eedda4627f582b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant: admin Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant-Name: admin Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User: admin Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Domain-Id: default Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Domain-Name: Default Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Id: 091e3a1287aa48ddab1a4bfa5166599f Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Name: admin Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: method: > Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: exception: Flavor 84 could not be found. Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: action_args: {'id': '84'} Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:30.755049 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:30.756014 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.757330 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-0d6105e4-7757-4e52-a270-7df9f5698810 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:30.759262 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-0d6105e4-7757-4e52-a270-7df9f5698810 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061643 Jun 23 22:38:30.759262 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 23 22:38:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:38:30.765747 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-5509c84a-ecfa-4bbe-8a85-806e315f0226 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:30.780239 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-5509c84a-ecfa-4bbe-8a85-806e315f0226 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018313 Jun 23 22:38:30.780794 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 22:38:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:38:30.790326 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-cc03c8c8-5a14-4873-881b-a7d6971a6fa2 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:30.803803 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-cc03c8c8-5a14-4873-881b-a7d6971a6fa2 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017195 Jun 23 22:38:30.804284 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 22:38:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:38:30.813325 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-729af25b-ad49-417c-bd3f-e5523ffa29e7 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:30.818503 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.wsgi [None req-729af25b-ad49-417c-bd3f-e5523ffa29e7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-729af25b-ad49-417c-bd3f-e5523ffa29e7 admin admin] Request method failure captured: Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Accept: application/json Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Accept-Encoding: gzip, deflate Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Connection: keep-alive Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Content-Length: 0 Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Host: 10.222.0.33 Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Openstack-Api-Version: compute 2.90 Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Openstack-System-Scope: None Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: User-Agent: python-novaclient Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Auth-Token: gAAAAABitOtmXpe7da_pYtv3C-9w9aEbcle4jYZ1EjfQF9L9kb2KFfs2q3WLCF6bSLeWClKabs9KnxrJ-L42qx945U3sb-Sv7iPr5dfrA3Av_9bSsylsqC-5688APXmHQuLCQoOdiDPonSSQxz9mvcDg-q56au-jJONOLbbvsklhdtCXOKHTTTg Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Domain-Id: None Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Domain-Name: None Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Identity-Status: Confirmed Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Is-Admin-Project: True Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Domain-Id: default Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Domain-Name: Default Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Name: admin Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Role: reader,member,admin Jun 23 22:38:30.820014 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Roles: reader,member,admin Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0d9b0cc6e44015a1eedda4627f582b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant: admin Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant-Name: admin Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User: admin Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Domain-Id: default Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Domain-Name: Default Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Id: 091e3a1287aa48ddab1a4bfa5166599f Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Name: admin Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: method: > Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: exception: Flavor 84 could not be found. Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: action_args: {'id': '84'} Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:30.821943 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:30.823302 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:30.824626 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-729af25b-ad49-417c-bd3f-e5523ffa29e7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:30.825863 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-729af25b-ad49-417c-bd3f-e5523ffa29e7 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012130 Jun 23 22:38:30.825863 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Thu Jun 23 22:38:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 22:38:31.649164 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-cc03c8c8-5a14-4873-881b-a7d6971a6fa2 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:31.650287 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-cc03c8c8-5a14-4873-881b-a7d6971a6fa2 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Jun 23 22:38:31.650697 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:38:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:31.840478 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-cbb5c6d4-4f21-42d7-9b69-f9f3ae37600c admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:31.846154 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.wsgi [None req-cbb5c6d4-4f21-42d7-9b69-f9f3ae37600c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-cbb5c6d4-4f21-42d7-9b69-f9f3ae37600c admin admin] Request method failure captured: Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Accept: application/json Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Accept-Encoding: gzip, deflate Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Connection: keep-alive Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Content-Length: 0 Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Host: 10.222.0.33 Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Openstack-Api-Version: compute 2.90 Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Openstack-System-Scope: None Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: User-Agent: python-novaclient Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Auth-Token: gAAAAABitOtntT9fSAi5m88y3KH8EPX61I57B5WLEoRIgcs5rbM8JhJkdjHJq8b_Eyq3Ct1nFhhcyqiy0AJHuq6vqHw9V7qw5qgDTVfoPNSIp-krlxKnvQeSgDm5wPHWPwiIiGD5WgN0mgPtAxUZz7m8AuPTogGf6JBbitIvq_VNfEixPR4t9cg Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Domain-Id: None Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Domain-Name: None Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Identity-Status: Confirmed Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Is-Admin-Project: True Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Domain-Id: default Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Domain-Name: Default Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Project-Name: admin Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Role: reader,member,admin Jun 23 22:38:31.847645 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Roles: reader,member,admin Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0d9b0cc6e44015a1eedda4627f582b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant: admin Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-Tenant-Name: admin Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User: admin Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Domain-Id: default Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Domain-Name: Default Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Id: 091e3a1287aa48ddab1a4bfa5166599f Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: X-User-Name: admin Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: method: > Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: exception: Flavor 451 could not be found. Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: action_args: {'id': '451'} Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:31.849211 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:31.850098 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.851397 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-cbb5c6d4-4f21-42d7-9b69-f9f3ae37600c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110176) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:31.852883 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-cbb5c6d4-4f21-42d7-9b69-f9f3ae37600c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059016 Jun 23 22:38:31.852883 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 22:38:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:38:31.858656 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-bc90094f-3f2f-4832-8f54-835090b3f0d6 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:31.872645 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-bc90094f-3f2f-4832-8f54-835090b3f0d6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017555 Jun 23 22:38:31.873173 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 22:38:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:38:31.882204 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:31.896350 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017518 Jun 23 22:38:31.896894 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Thu Jun 23 22:38:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:38:31.905781 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-bd4a508f-8c14-4541-8082-49a3eac8637d admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:31.911046 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.wsgi [None req-bd4a508f-8c14-4541-8082-49a3eac8637d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-bd4a508f-8c14-4541-8082-49a3eac8637d admin admin] Request method failure captured: Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Accept: application/json Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Accept-Encoding: gzip, deflate Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Connection: keep-alive Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Content-Length: 0 Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Host: 10.222.0.33 Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Openstack-Api-Version: compute 2.90 Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Openstack-System-Scope: None Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: User-Agent: python-novaclient Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Auth-Token: gAAAAABitOtntT9fSAi5m88y3KH8EPX61I57B5WLEoRIgcs5rbM8JhJkdjHJq8b_Eyq3Ct1nFhhcyqiy0AJHuq6vqHw9V7qw5qgDTVfoPNSIp-krlxKnvQeSgDm5wPHWPwiIiGD5WgN0mgPtAxUZz7m8AuPTogGf6JBbitIvq_VNfEixPR4t9cg Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Domain-Id: None Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Domain-Name: None Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Identity-Status: Confirmed Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Is-Admin-Project: True Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Domain-Id: default Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Domain-Name: Default Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Project-Name: admin Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Role: reader,member,admin Jun 23 22:38:31.912542 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Roles: reader,member,admin Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3f0d9b0cc6e44015a1eedda4627f582b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3f0d9b0cc6e44015a1eedda4627f582b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant: admin Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant-Id: 3f0d9b0cc6e44015a1eedda4627f582b Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-Tenant-Name: admin Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User: admin Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Domain-Id: default Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Domain-Name: Default Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Id: 091e3a1287aa48ddab1a4bfa5166599f Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: X-User-Name: admin Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: method: > Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: exception: Flavor 451 could not be found. Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: action_args: {'id': '451'} Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:38:31.914072 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:31.914942 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: ERROR nova.api.openstack.wsgi Jun 23 22:38:31.916211 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-bd4a508f-8c14-4541-8082-49a3eac8637d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110177) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:38:31.917460 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-bd4a508f-8c14-4541-8082-49a3eac8637d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011632 Jun 23 22:38:31.917460 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 22:38:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 22:38:32.737407 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:32.738433 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 23 22:38:32.738834 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:38:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:32.928840 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-2a20f4de-a081-4d01-8475-c100c24289d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:33.016464 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-2a20f4de-a081-4d01-8475-c100c24289d9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.139634 Jun 23 22:38:33.017036 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 23 22:38:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:38:33.835784 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:33.837226 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001989 Jun 23 22:38:33.837620 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:38:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:34.026838 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-bbe40357-b5cc-402d-bfd4-f50b9cd7b102 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:34.104498 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-bbe40357-b5cc-402d-bfd4-f50b9cd7b102 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.128984 Jun 23 22:38:34.104997 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 23 22:38:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:38:34.965768 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:34.966806 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 23 22:38:34.967198 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:35.185207 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-d458e246-37c5-4e65-8c83-e91d57c26ad5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:35.268066 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-d458e246-37c5-4e65-8c83-e91d57c26ad5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.141393 Jun 23 22:38:35.268648 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 23 22:38:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:38:36.133636 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:36.134657 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 23 22:38:36.135059 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:38:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:36.325952 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-37a9271f-ea93-4883-ad3b-bf61d7d95e9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:38:36.390694 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-37a9271f-ea93-4883-ad3b-bf61d7d95e9d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.116469 Jun 23 22:38:36.391261 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Thu Jun 23 22:38:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:38:37.216848 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:37.217870 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 23 22:38:37.218266 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:38:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:38:37.409507 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-fdc3d3de-633e-4979-941f-044652946cf4 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:38:37.429936 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-fdc3d3de-633e-4979-941f-044652946cf4 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073136 Jun 23 22:38:37.430416 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Thu Jun 23 22:38:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:39:23.922426 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:23.923442 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-7b76c5bf-514f-4f88-8c47-c5e8470e5584 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 23 22:39:23.923841 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Thu Jun 23 22:39:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:39:23.934381 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:23.983001 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-17b972ed-3e80-4327-b8cb-887090553582 admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:24.002409 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-17b972ed-3e80-4327-b8cb-887090553582 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072455 Jun 23 22:39:24.002946 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Thu Jun 23 22:39:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:39:24.027189 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-8d3b1051-f459-4716-885a-7a8afaf661fb admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:24.030658 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG dbcounter [-] [110176] Writing DB stats nova_api:SELECT=14 {{(pid=110176) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:39:24.035628 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-8d3b1051-f459-4716-885a-7a8afaf661fb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012017 Jun 23 22:39:24.041236 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jun 23 22:39:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:24.047453 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-3ce1d285-4a75-4b27-9b49-d5dab32cb70e admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:24.055561 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-3ce1d285-4a75-4b27-9b49-d5dab32cb70e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011603 Jun 23 22:39:24.056074 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jun 23 22:39:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:39:24.067827 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:24.076215 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012426 Jun 23 22:39:24.076760 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Thu Jun 23 22:39:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:39:24.088248 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-a1d06a0e-4a60-401e-a149-923be183f77a admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:39:24.095645 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-a1d06a0e-4a60-401e-a149-923be183f77a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010794 Jun 23 22:39:24.096147 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Thu Jun 23 22:39:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:43:08.537524 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:08.538624 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 23 22:43:08.538967 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:43:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:43:08.682488 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_api:SELECT=6 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:08.795785 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-d92c87be-ae36-4ace-bd9f-577ffb3799cd admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:08.797140 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:43:08.797140 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: warnings.warn(msg) Jun 23 22:43:08.798332 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-d92c87be-ae36-4ace-bd9f-577ffb3799cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:08.798768 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-d92c87be-ae36-4ace-bd9f-577ffb3799cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:08.799544 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-d92c87be-ae36-4ace-bd9f-577ffb3799cd admin admin] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:08.799968 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-d92c87be-ae36-4ace-bd9f-577ffb3799cd admin admin] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:08.834160 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-d92c87be-ae36-4ace-bd9f-577ffb3799cd admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153076 Jun 23 22:43:08.834974 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 22:43:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:43:09.663385 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:09.664406 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 23 22:43:09.664849 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:43:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:43:09.858124 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-3fed8ea0-8510-4121-ac95-9180aaef9e8b admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:09.859343 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:43:09.859343 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: warnings.warn(msg) Jun 23 22:43:09.860523 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-3fed8ea0-8510-4121-ac95-9180aaef9e8b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.860993 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-3fed8ea0-8510-4121-ac95-9180aaef9e8b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.861769 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-3fed8ea0-8510-4121-ac95-9180aaef9e8b admin admin] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:09.862203 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-3fed8ea0-8510-4121-ac95-9180aaef9e8b admin admin] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:09.882271 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-3fed8ea0-8510-4121-ac95-9180aaef9e8b admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076855 Jun 23 22:43:09.882758 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 22:43:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:43:21.121685 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:21.126039 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 23 22:43:21.126039 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:43:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:43:21.270978 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_cell0:SELECT=4 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:21.271703 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_cell1:SELECT=4 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:21.272306 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG dbcounter [-] [110177] Writing DB stats nova_api:SELECT=8 {{(pid=110177) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:43:21.321387 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-9c04192f-bf29-4a61-8603-e5ef447b010a admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:21.322553 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:43:21.322553 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: warnings.warn(msg) Jun 23 22:43:21.323735 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-9c04192f-bf29-4a61-8603-e5ef447b010a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:21.324178 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-9c04192f-bf29-4a61-8603-e5ef447b010a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:21.325022 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-9c04192f-bf29-4a61-8603-e5ef447b010a admin admin] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:21.325487 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-9c04192f-bf29-4a61-8603-e5ef447b010a admin admin] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:21.351877 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-9c04192f-bf29-4a61-8603-e5ef447b010a admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085496 Jun 23 22:43:21.352437 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 22:43:21 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:43:22.178514 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: DEBUG nova.api.openstack.wsgi [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] Calling method '>' {{(pid=110176) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:22.179587 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: INFO nova.api.openstack.requestlog [None req-dcbdbaa3-6196-472f-8ddf-975f226b03f5 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 23 22:43:22.179983 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: [pid: 110176|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Thu Jun 23 22:43:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:43:22.379660 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG nova.api.openstack.wsgi [None req-f9954163-0432-44ae-997b-f895ab817e3b admin admin] Calling method '>' {{(pid=110177) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:43:22.380848 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 22:43:22.380848 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: warnings.warn(msg) Jun 23 22:43:22.382017 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-f9954163-0432-44ae-997b-f895ab817e3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:22.382455 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-f9954163-0432-44ae-997b-f895ab817e3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:22.383246 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-f9954163-0432-44ae-997b-f895ab817e3b admin admin] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:43:22.383672 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: DEBUG oslo_concurrency.lockutils [None req-f9954163-0432-44ae-997b-f895ab817e3b admin admin] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110177) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:43:22.405090 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: INFO nova.api.openstack.requestlog [None req-f9954163-0432-44ae-997b-f895ab817e3b admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079129 Jun 23 22:43:22.405822 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: [pid: 110177|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Thu Jun 23 22:43:22 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:44:17.966794 dv-cinder-813229-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 22:44:17.967328 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: Thu Jun 23 22:44:17 2022 - graceful shutdown triggered... Jun 23 22:44:17.967785 dv-cinder-813229-11-iscsi devstack@n-api.service[110176]: Gracefully killing worker 1 (pid: 110176)... Jun 23 22:44:17.968202 dv-cinder-813229-11-iscsi devstack@n-api.service[110177]: Gracefully killing worker 2 (pid: 110177)... Jun 23 22:44:18.968560 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: worker 1 buried after 1 seconds Jun 23 22:44:18.969169 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: worker 2 buried after 1 seconds Jun 23 22:44:18.969169 dv-cinder-813229-11-iscsi devstack@n-api.service[110175]: goodbye to uWSGI. Jun 23 22:44:18.970294 dv-cinder-813229-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 22:44:18.970866 dv-cinder-813229-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 22:44:18.973697 dv-cinder-813229-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 22:44:18.983269 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 22:44:18 2022] *** Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: nodename: dv-cinder-813229-11-iscsi Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: machine: x86_64 Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: clock source: unix Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: pcre jit disabled Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: detected number of CPU cores: 4 Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: current working directory: / Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: detected binary path: /usr/bin/uwsgi-core Jun 23 22:44:18.985322 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: your processes number limit is 47680 Jun 23 22:44:18.986032 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: your memory page size is 4096 bytes Jun 23 22:44:18.986032 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: detected max file descriptor number: 2048 Jun 23 22:44:18.986032 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: lock engine: pthread robust mutexes Jun 23 22:44:18.986032 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: thunder lock: enabled Jun 23 22:44:18.986032 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 22:44:18.986032 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 22:44:19.031753 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: Python main interpreter initialized at 0x558edf06e9c0 Jun 23 22:44:19.031753 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: python threads support enabled Jun 23 22:44:19.031753 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: your server socket listen backlog is limited to 100 connections Jun 23 22:44:19.031753 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: your mercy for graceful operations on workers is 90 seconds Jun 23 22:44:19.031753 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 22:44:19.031753 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: *** Operational MODE: preforking *** Jun 23 22:44:19.031753 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: *** uWSGI is running in multiple interpreter mode *** Jun 23 22:44:19.031753 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: spawned uWSGI master process (pid: 124710) Jun 23 22:44:19.032492 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: spawned uWSGI worker 1 (pid: 124724, cores: 1) Jun 23 22:44:19.031950 dv-cinder-813229-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 22:44:19.032848 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: spawned uWSGI worker 2 (pid: 124725, cores: 1) Jun 23 22:44:19.033163 dv-cinder-813229-11-iscsi devstack@n-api.service[124710]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 22:44:19.694825 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 22:44:19.699838 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 22:44:20.903788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:44:20.903788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: from cryptography.utils import int_from_bytes Jun 23 22:44:20.904530 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:44:20.904530 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: from cryptography.utils import int_from_bytes Jun 23 22:44:20.905238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:44:20.905238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: from cryptography.utils import int_from_bytes Jun 23 22:44:20.905774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 22:44:20.905774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: from cryptography.utils import int_from_bytes Jun 23 22:44:23.322920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 22:44:23.323483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 22:44:23.323729 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 22:44:23.324050 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 22:44:23.324302 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 22:44:23.324709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.325031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.325350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.325667 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.325948 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 22:44:23.326322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.326404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 22:44:23.326486 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.326660 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.326767 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 22:44:23.326923 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.327748 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 22:44:23.327867 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.328191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 22:44:23.328303 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.328395 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.328465 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.328734 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-11-iscsi {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.328926 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.329083 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.329257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.329371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.329576 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.329733 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.329908 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.330067 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.330225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.330374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.330521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.330669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.330821 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.330969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.331138 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.331310 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.332822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.332822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.333270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.333500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-813229-11-iscsi {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.333722 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.333937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.334143 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.334361 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.334582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.334805 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.335008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.335226 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.335460 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.335666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.335880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.336101 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.336305 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.336519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.336748 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.336748 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.337175 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.337397 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-11-iscsi {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.337610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.337835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.338039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.338225 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.338412 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.338592 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.338746 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.338746 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.339073 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.339234 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.339789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.339950 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.340101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.340244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.340420 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.340949 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.341138 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.341294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.341452 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.341452 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.344250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-813229-11-iscsi {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.344416 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.344599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.344783 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.344932 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.345092 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.345257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.345401 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.345560 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.345705 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.345859 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.346012 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.346155 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.346297 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.346446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.346596 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.346745 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.346903 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.347054 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.347213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.347356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.347504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.347708 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.347862 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.348013 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.348156 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.348304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.348455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.348455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.348779 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.348929 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.349091 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.349241 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.349394 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.349941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.350102 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.350254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.350405 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.350548 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.351196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.351359 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.351514 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.351664 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.351823 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.351974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.352132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.352283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.352426 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.352568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.352889 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.353166 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.353329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.353475 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.353668 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.353818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.353977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.354138 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.354292 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.354435 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.354578 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.354727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.354884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.354884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.355163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.355306 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.355455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.355599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.355766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.356024 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.356176 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.356327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.356477 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.356646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.356807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.356950 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.357093 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.357240 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.357384 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.357535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.357691 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.357853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.358094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.358741 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.358897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.358897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.359191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.359191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.359470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.360006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.360162 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.360324 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.360468 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.360468 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.360976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.361331 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.361484 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.361642 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.361786 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.361928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.362070 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.362212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.362354 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.362509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.362661 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.362811 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.362953 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.363112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.363261 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.363413 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.363563 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.363706 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.363848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.363996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.364151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.364295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.364436 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.364603 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.364861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.365022 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.365179 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.365332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.365493 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.365636 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.365779 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.365920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.366076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.366219 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.366367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.366509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.366656 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.366799 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.366967 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.367118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.367262 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.367418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.367569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.367569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.367854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.367997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.368139 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.368297 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.368447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.368617 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.368776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.368936 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.369088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.369238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.369381 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.369523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.369672 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.370543 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.370714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.370858 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.371692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.371783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.371873 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.371960 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372043 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372121 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372193 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372277 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372607 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372703 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372792 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372871 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.372871 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373084 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373155 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373234 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373313 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373390 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.373895 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.374478 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.374575 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.374728 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.374865 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.375006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.375165 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.375310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.375406 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.375491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.375571 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.375642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.375642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.376038 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.376124 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.376209 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.376292 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.376364 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.376440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.376511 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.376619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.376713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.376788 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.376866 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.376946 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.377018 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.377096 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.377175 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.377253 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.377331 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.377407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.377505 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.377594 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 22:44:23.377666 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.377666 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.377808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.377889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378135 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378207 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378360 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378360 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378587 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378664 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378735 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378811 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.378975 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379195 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379274 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379416 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379507 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379586 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379663 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379734 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.379975 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.380054 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.380131 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.380209 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.380286 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.380366 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.380443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.380521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.382139 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.382282 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.382400 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.382528 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.382644 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.382763 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.382885 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.382999 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.383112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.383237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.383351 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.383472 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.383600 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.383722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.383844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.383966 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.384079 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.384191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.384302 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.384413 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.384535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.384709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.384827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.384947 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385155 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385240 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385313 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385588 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385700 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.385943 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386058 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386279 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386389 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386498 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386739 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386852 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.386973 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.387104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.387380 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.387519 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.387641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.387756 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.387867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.387978 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.388099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.388211 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.388322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.388442 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.388561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.388725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.388864 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.388941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.389012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.389090 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.389242 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.389356 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.389539 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.389685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.389877 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.390073 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.390293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.390448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.390581 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.390701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.390819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.390934 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.391045 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.391169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.391289 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.391428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.391696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.391825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.391950 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.392075 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.392295 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.392514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.392648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.392779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.392901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393029 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393029 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393473 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393592 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393837 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.393956 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.394069 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.394181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.394302 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.394422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.394422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.394629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.395319 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.395465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.395590 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.395733 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.395865 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.395996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.396127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.396260 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.396404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.396552 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.396836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.396975 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.397094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.397217 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.397343 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.397457 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.397577 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.397689 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.397800 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.397926 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398158 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398158 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398388 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398630 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398750 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398870 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.398981 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.399093 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.399211 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.399333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.399463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.399587 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.399706 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.399824 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.399944 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.400138 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.400261 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.400384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.400504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.400634 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.400770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.400892 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.401015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.401129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.401240 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.401351 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.401477 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.401613 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.401887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.402014 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.402135 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.402254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.402489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.402616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.402752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.402956 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.403082 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.403202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.403326 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.403439 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.403439 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.403658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.403776 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.403902 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404149 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404149 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404638 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404638 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.404981 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.405117 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.405278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.405497 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.405708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.405853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.405853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.406094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.406232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.406375 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.406512 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.406512 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.406756 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.406756 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.406963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.407088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.407200 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.407200 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.407422 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.407544 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.407670 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.407791 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.407911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.408024 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.408134 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.408353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.408517 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.408791 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.408945 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.409102 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.409248 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.409402 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.409572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.409720 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.409874 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.409874 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.410164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.410310 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.410469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.410624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.410792 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.410940 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.411092 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.411251 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.411405 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.411557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.411702 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.412008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.412168 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.412330 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.412506 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.412757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.412920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.413174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.413324 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.413488 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.413642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.413789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.413936 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.414089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.414235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.414395 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.414549 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.414701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.414853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.415010 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.415163 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.415318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.415471 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.415616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.415769 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.415921 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.416707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.416869 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.417024 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.417172 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.417328 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.417475 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.417646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.417794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.417947 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.418094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.418248 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.418408 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.418564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.418711 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.418898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.419048 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.419194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.419341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.419501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.419661 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.419821 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.419977 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.420123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.420283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.420430 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.420602 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.421278 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.421495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.421737 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.422156 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.422314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.422481 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.422629 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.422793 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.423036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.423216 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.423452 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.423604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.423750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.423896 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.424041 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.424197 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.424344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.424491 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.424710 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.424860 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.425016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.425163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.425308 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.425453 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.425607 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.425761 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.425917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.426063 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.426208 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.426360 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.426505 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.426662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.426817 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.426962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.427108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.427840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.428002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.428151 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.428297 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.428444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.428623 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.428788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.428953 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.429347 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.429505 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.429653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.429885 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.430045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.430193 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.430347 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.430501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.430649 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.430806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.430953 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.431099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.431266 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.431413 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.431568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.431715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.431861 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.432006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.432341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.432496 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.432727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.432888 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.432888 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.433305 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.433475 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.433754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.433923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.434071 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.434225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.434379 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.434533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.434689 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.435444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.435607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.435765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.435913 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.436060 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.436227 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.436438 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.437241 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.437241 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.437730 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.437980 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.438137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.438292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.438446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.438607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.438755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.438908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.439056 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.439228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.439376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.439538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.439693 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.439839 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.439839 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.440131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.440283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.440450 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.440625 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.440796 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.440953 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.441104 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.441104 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.441104 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.441537 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.441691 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.441847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.442001 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.442568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.442718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.442817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.442904 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443005 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443542 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443650 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443842 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.443926 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444102 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444197 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444290 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444290 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444445 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444529 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444730 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444814 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.444990 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445073 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445166 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445335 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445584 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445678 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445863 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.445948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446040 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446140 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446308 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446491 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446576 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446848 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.446932 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447115 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447303 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447394 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447576 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447656 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.447913 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448011 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448098 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448519 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.448919 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449007 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449099 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449193 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449279 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449371 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449598 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449793 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.449890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.450108 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.450203 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.450411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.450507 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.450715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.450810 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.451021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.451132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.451332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.451434 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.451641 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.451743 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.451961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.452090 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.452356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.452771 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.452937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.453031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.453106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.453188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.453273 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.453434 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.453572 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.453748 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.453868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.454055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.454175 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.454362 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.454501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.454673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.454819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.454997 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.455129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.455312 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.455438 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.455617 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.455752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.455925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.456061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.456226 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.456371 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.456530 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.456758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.456849 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.457029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.457151 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.457625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.457901 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.458020 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.458224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.458336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.458520 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.458612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.458826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.458925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.459129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.459219 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.459438 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.459536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.459742 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.459842 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.460044 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.460145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.460346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.460449 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.460669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.460764 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.460974 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.461076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.461298 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.461390 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.461610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.461710 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.461916 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.462015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.462223 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.462329 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.462544 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.462635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.462858 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.462966 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.463168 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.463270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.463482 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.463591 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.463789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.463891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.464105 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.464261 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.464416 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.464509 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.464784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.464895 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.465114 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.465272 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.465439 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.465590 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.465762 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.466085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.466440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.466601 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.466747 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.466890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.467061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.467224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.468181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.468349 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.468496 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.468687 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.468836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.468980 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.469135 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.469280 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.469280 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.469553 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.469697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.469840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.469994 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.470147 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.470288 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.470444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.470444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.470741 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.470959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.471250 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.471392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.471579 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.471708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.471894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.472013 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.472212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.472332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.472531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.472782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.472924 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.473118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.473218 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.473514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.473685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.473827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.473980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.474122 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.474268 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.474435 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.474582 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.474762 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.474913 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.475070 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.475207 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.475374 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.475520 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.475671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.475815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.475963 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.476101 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.476276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.476416 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.476564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.476732 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.477033 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.477180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.477339 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.477482 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.477653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.477760 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.477963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.478064 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.478279 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.478383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.478592 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.478692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.478909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.479008 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.479225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.479326 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.479531 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.479628 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.479950 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.480043 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.480266 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.480369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.480598 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.480704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.480910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.481010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.481216 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.481317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.481521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.481619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.481832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.481922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.482157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.482263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.482464 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.482601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.482769 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.482886 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.483073 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.483707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.483922 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.484064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.484228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.484428 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.484533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.484790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.484986 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.485215 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.485329 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.485531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.485653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.485841 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.485996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.486259 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.486358 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.486576 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.486685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.486892 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.486992 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.487222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.487321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.487546 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.487638 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.487855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.487953 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.488171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.488372 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.488470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.488565 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.488817 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.488921 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.489146 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.489245 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.489464 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.489562 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.489778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.489868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.490181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.490325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.490440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.490551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.490707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.490815 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.491021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.491120 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.491337 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.491434 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.491663 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.491754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.492062 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.492153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.492375 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.492467 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.492721 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.492841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.493051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.493149 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.493360 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.493462 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.493672 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.493774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.493979 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.494077 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.494286 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.494386 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.494593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.494711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.494900 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.494991 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.495209 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.495299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.495521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.495624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.495830 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.495928 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.496141 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.496241 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.496447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.496539 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.496777 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.496868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.497086 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.497187 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.497393 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.497483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.497711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.497870 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.498023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.498113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.498339 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.498437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.498658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.498755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.499529 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.499637 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.499845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.499938 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.500177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.500280 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.500497 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.500658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.501082 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.501200 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.501392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.501486 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.501704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.501814 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.502032 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.502135 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.502355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.502449 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.502679 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.502781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.503006 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.503105 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.503328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.503443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.503635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.503739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.503965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.504061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.504284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.504452 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.504665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.504758 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.504934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.505027 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.505238 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.505329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.505544 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.505636 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.505853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.505951 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.506156 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.506293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.506462 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.506581 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.506767 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.506885 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.507072 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.507166 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.507373 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.507471 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.507680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.507772 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.507986 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.508090 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.508297 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.508390 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.508616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.508722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.508943 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.509047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.509251 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.509344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.509555 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.509654 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.509859 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.509960 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.510162 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.510262 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.510470 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.510684 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.510779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.510873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.511111 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.511224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.511426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.511541 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.511747 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.511842 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.512069 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.512170 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.512375 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.512475 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.512720 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.512831 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.513039 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.513132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.513353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.513461 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.513667 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.513770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.513984 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.514083 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.514294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.514401 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.514701 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.514877 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.515040 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.515195 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.515316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.515430 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.515629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.515724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.515941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.516035 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.516256 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.516360 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.516607 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.516947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.517206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.517299 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.517550 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.517658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.517876 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.517982 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.518188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.518301 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.518504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.518682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.518819 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.518985 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.519132 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.519282 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.519441 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.519580 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.519717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.519857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.520012 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.520158 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.520334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.520482 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.520682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.520805 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.521009 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.521105 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.521337 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.521429 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.521653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.521751 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.521970 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.522073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.522284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.522377 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.522599 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.522692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.522918 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.523019 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.523256 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.523348 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.523565 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.523675 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.523877 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.523980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.524192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.524284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.524503 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.524666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.524848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.525014 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.525152 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.525292 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.525461 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.525612 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.525759 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.525898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.526081 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.526216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.526355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.526507 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.526644 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.526790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.526937 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.527081 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.527259 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.527414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.527587 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.527727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.527905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.528039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.528217 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.528365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.528538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.528678 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.528854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.528954 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.529180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.529369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.529684 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.529774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.530000 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.530110 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.530353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.530466 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.530680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.530838 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.530995 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.531182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.531343 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.531498 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.531643 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.531796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.531938 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.532087 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.532228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.532376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.532526 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.532654 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.532822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.532930 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.533126 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.533226 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.533432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.533533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.533749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.533868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.534053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.534147 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.534356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.534456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.534666 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.534771 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.534982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.535192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.535513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.535660 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.535841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.535989 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.536165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.536305 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.536487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.536665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.536830 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.536924 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.537137 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.537229 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.537450 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.537541 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.537757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.537856 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.538062 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.538160 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.538370 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.538459 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.538681 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.538827 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.538987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.539124 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.539292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.539393 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.539641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.539749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.539906 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.539997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.540209 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.540310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.540515 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.540627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.540843 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.540934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.541169 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.541284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.541472 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.541625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.541775 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.541868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.542078 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.542183 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.542383 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.542473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.542684 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.542773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.542987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.543079 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.543287 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.543385 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.543588 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.543687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.543894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.543996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.544195 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.544286 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.544501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.544629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.544829 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.544929 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.545136 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.545233 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.545438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.545535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.546256 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.546404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.546607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.546741 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.547009 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.547112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.547336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.547436 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.547644 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.547735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.547956 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.548120 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.548276 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.548368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.548605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.548744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.548917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.549019 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.549229 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.549329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.549556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.549655 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.549882 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.549983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.550216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.550411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.550746 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.550849 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.551066 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.551178 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.551393 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.551494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.551718 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.551816 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.552025 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.552126 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.552334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.552434 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.552668 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.552776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.552994 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.553128 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.553310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.553401 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.553625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.553716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.553981 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.554085 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.554247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.554338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.554562 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.554668 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.554869 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.554960 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.555179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.555309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.555488 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.555591 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.555797 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.555896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.556107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.556205 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.556412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.556515 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.556745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.556840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.557054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.557146 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.557364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.557455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.557686 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.557779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.558005 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.558105 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.558322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.558430 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.558637 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.558729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.558954 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.559047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.559262 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.559360 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.559572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.559664 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.559879 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.559983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.560188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.560287 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.560499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.560627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.560845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.560951 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.561157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.561265 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.562099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.562298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.562514 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.562804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.562978 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.563121 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.563296 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.563443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.563622 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.563766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.563948 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.564064 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.564267 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.564379 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.564606 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.564716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.564945 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.565110 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.565253 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.565347 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.565577 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.565680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.565891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.565983 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.566223 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.566324 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.566563 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.566677 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.566898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.567019 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.567200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.567342 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.567522 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.567808 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.567905 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.568123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.568217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.568434 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.568540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.568779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.568895 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.569094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.569213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.569400 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.569506 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.569700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.569800 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.570009 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.570112 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.570318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.570420 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.570605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.570699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.570907 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.571013 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.571213 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.571371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.571526 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.571672 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.571813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.571965 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.572112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.572214 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.572383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.572531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.572765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.572907 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.573045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.573191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.573329 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.573476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.573623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.573761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.573898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.574046 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.574192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.574422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.574569 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.574718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.574865 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.575010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.575154 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.575292 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.575439 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.575541 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.575674 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.575814 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.575960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.576106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.576281 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.576438 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.576606 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.576700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.576925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.577100 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.577282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.577485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.577607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.577851 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.577944 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.578180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.578282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.578500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.578592 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.578814 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.578917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.583495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.583633 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.583745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.583836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.583922 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584018 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584331 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584442 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584530 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584643 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584732 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584817 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584902 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.584994 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585086 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585460 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585545 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585638 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585790 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.585964 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586048 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586145 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586333 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586417 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586507 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586700 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586785 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586867 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.586957 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587048 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587142 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587235 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587404 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587577 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587669 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587753 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.587928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588019 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588290 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588372 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588547 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588844 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.588937 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589022 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589113 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589204 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589342 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589442 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.589947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124725) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 22:44:23.590039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 22:44:23.590039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124724) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 22:44:23.651873 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO dbcounter [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Registered counter for database nova_api Jun 23 22:44:23.652403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO dbcounter [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Registered counter for database nova_api Jun 23 22:44:23.674414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:44:23.676020 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_db.sqlalchemy.engines [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:44:23.680941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writer thread running {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:44:23.682890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writer thread running {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:44:23.737958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.context [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f0b80a3-fbde-406f-b6e6-3de0c437540c(cell1) {{(pid=124725) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 22:44:23.740566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.context [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5f0b80a3-fbde-406f-b6e6-3de0c437540c(cell1) {{(pid=124724) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 22:44:23.742061 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:23.743660 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:23.744451 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:23.744659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:23.746268 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:23.746421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:23.747074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:44:23.748384 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO dbcounter [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Registered counter for database nova_cell0 Jun 23 22:44:23.749530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:44:23.751808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO dbcounter [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Registered counter for database nova_cell0 Jun 23 22:44:23.752809 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO dbcounter [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Registered counter for database nova_cell1 Jun 23 22:44:23.755845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO dbcounter [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Registered counter for database nova_cell1 Jun 23 22:44:23.760057 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:44:23.763200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:44:23.765564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_db.sqlalchemy.engines [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:44:23.766323 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_db.sqlalchemy.engines [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:44:23.766735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writer thread running {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:44:23.772051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writer thread running {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:44:23.908487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writer thread running {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:44:23.917508 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writer thread running {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:44:23.918476 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO dbcounter [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Registered counter for database nova_cell0 Jun 23 22:44:23.925826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_db.sqlalchemy.engines [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124725) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:44:23.927476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO dbcounter [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Registered counter for database nova_cell0 Jun 23 22:44:23.935828 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writer thread running {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:44:23.936122 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_db.sqlalchemy.engines [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124724) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 22:44:23.941175 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writer thread running {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 22:44:24.261671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: WARNING keystonemiddleware.auth_token [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:44:24.269952 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: WARNING keystonemiddleware.auth_token [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:44:24.273596 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: WARNING keystonemiddleware.auth_token [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:44:24.282630 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: WARNING keystonemiddleware.auth_token [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:44:24.618031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: WARNING keystonemiddleware.auth_token [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:44:24.624604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: WARNING keystonemiddleware.auth_token [None req-7fe7ae9e-0748-484b-b847-ea12879d0974 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:44:24.630542 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558edf06e9c0 pid: 124725 (default app) Jun 23 22:44:24.638533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: WARNING keystonemiddleware.auth_token [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 22:44:24.645599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: WARNING keystonemiddleware.auth_token [None req-0a47e62b-f201-440b-8b2e-dd370ee70399 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 22:44:24.651029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558edf06e9c0 pid: 124724 (default app) Jun 23 22:45:05.535609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:05.537878 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:05.539239 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:05.540412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:06.157739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e481ed7d-914e-475d-a193-b5d535e48a21 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Action: 'create', calling method: .version_select at 0x7fbbcc308700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2039869875", "metadata": {"Type": "work"}}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:07.614780 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:07.615758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:07.617471 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:07.618813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:07.639702 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e481ed7d-914e-475d-a193-b5d535e48a21 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.119826 Jun 23 22:45:07.641262 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 23 22:45:05 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2124 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 22:45:07.652881 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b4a06161-ae49-4c82-83fd-16d5be5efc61 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Calling method '.version_select at 0x7fbbcc1cd550>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:07.718575 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b4a06161-ae49-4c82-83fd-16d5be5efc61 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf" status: 200 len: 353 microversion: 2.1 time: 0.069525 Jun 23 22:45:07.719635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 2/2] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:07 2022] GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:45:07.998764 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f487f1e0-eb18-4bde-9b02-e09ca2a43e8a tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc351310>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:08.505800 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f487f1e0-eb18-4bde-9b02-e09ca2a43e8a tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/9006c552-ee39-488a-a785-14c6bb60ccc9" status: 200 len: 350 microversion: 2.1 time: 0.898174 Jun 23 22:45:08.506371 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 1/3] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:07 2022] GET /compute/v2.1/os-volumes/9006c552-ee39-488a-a785-14c6bb60ccc9 => generated 350 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:45:08.731569 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e7f08bd9-70ca-46a4-949c-2c4d55e12c4a tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Calling method '.version_select at 0x7fbbcc1cd670>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:08.791258 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e7f08bd9-70ca-46a4-949c-2c4d55e12c4a tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf" status: 200 len: 354 microversion: 2.1 time: 0.063528 Jun 23 22:45:08.792442 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:08 2022] GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf => generated 354 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:08.848990 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c381841c-41ad-4d50-9cac-c4bb649711b4 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Calling method '.version_select at 0x7fbbcc217820>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:09.007804 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c381841c-41ad-4d50-9cac-c4bb649711b4 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf" status: 200 len: 354 microversion: 2.1 time: 0.101227 Jun 23 22:45:09.007804 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 2/5] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:08 2022] GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:09.012888 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-434400ba-cdf7-4452-adae-94f175c3e7c4 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Calling method '.version_select at 0x7fbbcc1cdca0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:09.282363 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-434400ba-cdf7-4452-adae-94f175c3e7c4 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf" status: 202 len: 0 microversion: 2.1 time: 0.369780 Jun 23 22:45:09.282363 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 4/6] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:45:08 2022] DELETE /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:45:09.290747 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-222d29e6-373f-419a-97ff-537b26751b47 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Calling method '.version_select at 0x7fbbcc217ee0>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:09.604755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-222d29e6-373f-419a-97ff-537b26751b47 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf" status: 200 len: 353 microversion: 2.1 time: 0.115324 Jun 23 22:45:09.604755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 3/7] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:09 2022] GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:10.416695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2f525701-f1b8-4199-85c5-79d45e33ca10 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Calling method '.version_select at 0x7fbbcc1653a0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:10.459099 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-2f525701-f1b8-4199-85c5-79d45e33ca10 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] HTTP exception thrown: Volume 971f7e89-fb8b-4a26-9c0b-63fdb542debf could not be found. Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2f525701-f1b8-4199-85c5-79d45e33ca10 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Request method failure captured: Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf HTTP/1.1 Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOzxNUHqmB_zQ-EwJ5Mw7LwamJcMkQmFkDwRyYVaTPsJhzc-OKiSOpJV9olLYY4FgULiWicP6i1e5lS3SlQZecNuMRDwLAjOTByzHITbP_p-m4HjOuKAvB99KtY8d7-liPIoL86EVY4lGnKNvmmSUFm8TRg5CJuj0ZeMZBRuaHQ_ZRU Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: ecc700154c034f328172bcdc1487b88c Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesGetTestJSON-1310714867 Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:45:10.466990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ecc700154c034f328172bcdc1487b88c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ecc700154c034f328172bcdc1487b88c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecc700154c034f328172bcdc1487b88c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ecc700154c034f328172bcdc1487b88c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesGetTestJSON-1310714867 Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: ecc700154c034f328172bcdc1487b88c Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesGetTestJSON-1310714867 Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesGetTestJSON-1310714867-project Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: a53d7e0b52a84ce5966243f025277da2 Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesGetTestJSON-1310714867-project Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Volume 971f7e89-fb8b-4a26-9c0b-63fdb542debf could not be found. Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '971f7e89-fb8b-4a26-9c0b-63fdb542debf'} Jun 23 22:45:10.468150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 971f7e89-fb8b-4a26-9c0b-63fdb542debf could not be found. (HTTP 404) (Request-ID: req-1372e13d-90a8-4cd7-853e-da34fef1eb6b) Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:10.468847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:45:10.469766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 971f7e89-fb8b-4a26-9c0b-63fdb542debf could not be found. Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 22:45:10.474282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 971f7e89-fb8b-4a26-9c0b-63fdb542debf could not be found. Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 971f7e89-fb8b-4a26-9c0b-63fdb542debf could not be found. Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2f525701-f1b8-4199-85c5-79d45e33ca10 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] Returning 404 to user: Volume 971f7e89-fb8b-4a26-9c0b-63fdb542debf could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2f525701-f1b8-4199-85c5-79d45e33ca10 tempest-VolumesGetTestJSON-1310714867 tempest-VolumesGetTestJSON-1310714867-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf" status: 404 len: 109 microversion: 2.1 time: 0.058905 Jun 23 22:45:10.475622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 5/8] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:10 2022] GET /compute/v2.1/os-volumes/971f7e89-fb8b-4a26-9c0b-63fdb542debf => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:45:10.763149 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-265d93be-175d-439c-bfcf-ef0fe8727d36 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc217430>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:10.838156 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-265d93be-175d-439c-bfcf-ef0fe8727d36 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a4680f2f-66e6-464f-ba17-06dcd91c8e9f" status: 200 len: 351 microversion: 2.1 time: 0.079164 Jun 23 22:45:10.838715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 4/9] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:10 2022] GET /compute/v2.1/os-volumes/a4680f2f-66e6-464f-ba17-06dcd91c8e9f => generated 351 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:12.897877 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1db1fe63-adfd-4e09-86d9-5a3f58298680 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc165d30>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:12.989964 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1db1fe63-adfd-4e09-86d9-5a3f58298680 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f52206a7-0065-4abe-a048-ccd9a69565f2" status: 200 len: 351 microversion: 2.1 time: 0.094158 Jun 23 22:45:12.998409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 6/10] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:12 2022] GET /compute/v2.1/os-volumes/f52206a7-0065-4abe-a048-ccd9a69565f2 => generated 351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:13.007297 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a23bee2e-1ed8-400c-84ec-cd53ea74ad02 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc217790>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:13.138355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a23bee2e-1ed8-400c-84ec-cd53ea74ad02 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.137357 Jun 23 22:45:13.152447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ff2c5f2e-b3ef-4f36-9e7b-63fc229c9861 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc14f430>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:13.156213 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 5/11] 10.222.0.33 () {58 vars in 1133 bytes} [Thu Jun 23 22:45:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:13.307855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ff2c5f2e-b3ef-4f36-9e7b-63fc229c9861 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.158782 Jun 23 22:45:13.307855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 7/12] 10.222.0.33 () {58 vars in 1148 bytes} [Thu Jun 23 22:45:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:13.321729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4c103079-0882-46ad-903c-4d27124b7ed5 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc1c8820>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:13.444864 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4c103079-0882-46ad-903c-4d27124b7ed5 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.126342 Jun 23 22:45:13.454263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 6/13] 10.222.0.33 () {58 vars in 1133 bytes} [Thu Jun 23 22:45:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:13.459124 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b6474c3e-138b-4fd2-a11a-e384e2f23e35 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc165d30>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:13.635281 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b6474c3e-138b-4fd2-a11a-e384e2f23e35 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.181236 Jun 23 22:45:13.644232 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 8/14] 10.222.0.33 () {58 vars in 1166 bytes} [Thu Jun 23 22:45:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:13.650000 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-96351ddd-cf58-4d22-bbc8-91780d19c6e3 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc217a60>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:13.909495 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-96351ddd-cf58-4d22-bbc8-91780d19c6e3 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.263726 Jun 23 22:45:13.911641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 7/15] 10.222.0.33 () {58 vars in 1169 bytes} [Thu Jun 23 22:45:13 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:13.923413 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fe23004c-3104-4f1e-b967-1666a4ca52bd tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc14fb80>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:14.157162 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fe23004c-3104-4f1e-b967-1666a4ca52bd tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.237648 Jun 23 22:45:14.157877 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 9/16] 10.222.0.33 () {58 vars in 1154 bytes} [Thu Jun 23 22:45:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:14.170706 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-90227e47-79be-4fd1-94db-80b2c6c2110d tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc1c8430>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:14.432663 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-90227e47-79be-4fd1-94db-80b2c6c2110d tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.267053 Jun 23 22:45:14.434083 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 8/17] 10.222.0.33 () {58 vars in 1187 bytes} [Thu Jun 23 22:45:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:14.447555 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4365aea1-6bf9-4a5c-9efe-500b6790d978 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] Calling method '.version_select at 0x7fbbcc168820>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:14.757796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4365aea1-6bf9-4a5c-9efe-500b6790d978 tempest-VolumesTestJSON-1314432093 tempest-VolumesTestJSON-1314432093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.301523 Jun 23 22:45:14.757796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 10/18] 10.222.0.33 () {58 vars in 1154 bytes} [Thu Jun 23 22:45:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:16.712377 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e6145dd9-8a2f-4326-8524-087126d364c7 tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Action: 'create', calling method: .version_select at 0x7fbbcc1688b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-403175463", "metadata": {"Type": "work"}}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e6145dd9-8a2f-4326-8524-087126d364c7 tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Request method failure captured: Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 121 Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz8tlYVjsqGNQ4i4k7y5ZC2LCAxNBKSKf_UqabB5OsLE_lK5sK1dSiIbwwSOOz0FoppefBCMOM2Q42_gP_LbmeyhAhOuyAHv1MJkIULaeyM2W2wNYdEswTcBgDbSTU8wlirasaIPo5fYcUyhNNg5TcfhroocGulnf_CJ5_Jzn3RTmI Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:45:16.735421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_34d816bb36c34ae0ad52cfda34b3fa80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: da5d0201777c49369b1bab15101b3053 Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-403175463", "metadata": {"Type": "work"}}} Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: Jun 23 22:45:16.736780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-403175463', 'metadata': {'Type': 'work'}}}} Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise error Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:16.737559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 22:45:16.738731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 22:45:16.741599 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 22:45:16.741599 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.745407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9ef6ef5f-03fc-481b-945f-3a0a3172dc68 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'create', calling method: .version_select at 0x7fbbcc1c8280>, body: {"keypair": {"name": "tempest-keypair-1967843072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcLYNbFHzztrcWJ10bPTKoizLEjye6w19Trt5BbMx57K+7XMAkbkBkFRnr1VcardKQvUcFLm0OrncdRj0S/OiENeLmALhI9o5+wgwxjMzzmPdmjvzvEHCALccNJkR55WA=="}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:16.751655 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e6145dd9-8a2f-4326-8524-087126d364c7 tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:16.754983 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e6145dd9-8a2f-4326-8524-087126d364c7 tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.211536 Jun 23 22:45:16.755969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 11/19] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 23 22:45:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:45:16.778492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-168b8f67-12d0-4eae-9e23-4a622b50f2ce tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Action: 'create', calling method: .version_select at 0x7fbbcc14f670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-18378391", "metadata": {"Type": "work"}}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-168b8f67-12d0-4eae-9e23-4a622b50f2ce tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Request method failure captured: Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 118 Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz8tlYVjsqGNQ4i4k7y5ZC2LCAxNBKSKf_UqabB5OsLE_lK5sK1dSiIbwwSOOz0FoppefBCMOM2Q42_gP_LbmeyhAhOuyAHv1MJkIULaeyM2W2wNYdEswTcBgDbSTU8wlirasaIPo5fYcUyhNNg5TcfhroocGulnf_CJ5_Jzn3RTmI Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:45:16.789573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_34d816bb36c34ae0ad52cfda34b3fa80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: da5d0201777c49369b1bab15101b3053 Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-18378391", "metadata": {"Type": "work"}}} Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: Jun 23 22:45:16.791147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-18378391', 'metadata': {'Type': 'work'}}}} Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise error Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi '0' Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:16.791932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 22:45:16.793788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 22:45:16.794886 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 22:45:16.794886 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.796987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-168b8f67-12d0-4eae-9e23-4a622b50f2ce tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:16.798819 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-168b8f67-12d0-4eae-9e23-4a622b50f2ce tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037262 Jun 23 22:45:16.804325 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 12/20] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 23 22:45:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:45:16.815437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-da471278-f354-4b06-b5b9-b2679c96e8be tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Action: 'create', calling method: .version_select at 0x7fbbcc14fb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-840209563", "metadata": {"Type": "work"}}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:16.819995 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-9ef6ef5f-03fc-481b-945f-3a0a3172dc68 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Getting quotas for project 13b00f92bcc449daadba8838f4c87a62. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-da471278-f354-4b06-b5b9-b2679c96e8be tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Request method failure captured: Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 118 Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz8tlYVjsqGNQ4i4k7y5ZC2LCAxNBKSKf_UqabB5OsLE_lK5sK1dSiIbwwSOOz0FoppefBCMOM2Q42_gP_LbmeyhAhOuyAHv1MJkIULaeyM2W2wNYdEswTcBgDbSTU8wlirasaIPo5fYcUyhNNg5TcfhroocGulnf_CJ5_Jzn3RTmI Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:45:16.820662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_34d816bb36c34ae0ad52cfda34b3fa80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: da5d0201777c49369b1bab15101b3053 Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-840209563", "metadata": {"Type": "work"}}} Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: Jun 23 22:45:16.833556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-840209563', 'metadata': {'Type': 'work'}}}} Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise error Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi '' Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:16.834444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 22:45:16.835745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 22:45:16.836960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 22:45:16.836960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.836960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-da471278-f354-4b06-b5b9-b2679c96e8be tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:16.836960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-da471278-f354-4b06-b5b9-b2679c96e8be tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015051 Jun 23 22:45:16.836960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 13/21] 10.222.0.33 () {60 vars in 1155 bytes} [Thu Jun 23 22:45:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:45:16.837411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e1782dda-b2c7-4c99-9bf4-fd583c9ce0ac tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Calling method '.version_select at 0x7fbbcc168310>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:16.848750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-9ef6ef5f-03fc-481b-945f-3a0a3172dc68 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Getting quotas for user 5107e87ee4c34ef9ac96fa4a3a899bda and project 13b00f92bcc449daadba8838f4c87a62. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:16.907056 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-e1782dda-b2c7-4c99-9bf4-fd583c9ce0ac tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] HTTP exception thrown: Volume tempest-invalid-273724738 could not be found. Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e1782dda-b2c7-4c99-9bf4-fd583c9ce0ac tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Request method failure captured: Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-273724738 HTTP/1.1 Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz8tlYVjsqGNQ4i4k7y5ZC2LCAxNBKSKf_UqabB5OsLE_lK5sK1dSiIbwwSOOz0FoppefBCMOM2Q42_gP_LbmeyhAhOuyAHv1MJkIULaeyM2W2wNYdEswTcBgDbSTU8wlirasaIPo5fYcUyhNNg5TcfhroocGulnf_CJ5_Jzn3RTmI Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:45:16.909285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_34d816bb36c34ae0ad52cfda34b3fa80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: da5d0201777c49369b1bab15101b3053 Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Volume tempest-invalid-273724738 could not be found. Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': 'tempest-invalid-273724738'} Jun 23 22:45:16.910572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-273724738 could not be found. (HTTP 404) (Request-ID: req-d0fcb7a0-61c5-4272-a235-9d920f47e478) Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.911352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:45:16.912545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-273724738 could not be found. Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:45:16.913947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-273724738 could not be found. Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-273724738 could not be found. Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e1782dda-b2c7-4c99-9bf4-fd583c9ce0ac tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Returning 404 to user: Volume tempest-invalid-273724738 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e1782dda-b2c7-4c99-9bf4-fd583c9ce0ac tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-273724738" status: 404 len: 98 microversion: 2.1 time: 0.077616 Jun 23 22:45:16.914909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 14/22] 10.222.0.33 () {58 vars in 1214 bytes} [Thu Jun 23 22:45:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-273724738 => generated 98 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 23 22:45:16.924502 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-da8fc487-0a18-4bf3-b93d-89b06b679937 tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005317 Jun 23 22:45:16.925115 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 15/23] 10.222.0.33 () {58 vars in 1139 bytes} [Thu Jun 23 22:45:16 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 23 22:45:16.938030 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ceb24210-75d8-40ce-8634-1c7c92ff804f tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006081 Jun 23 22:45:16.941340 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 16/24] 10.222.0.33 () {58 vars in 1136 bytes} [Thu Jun 23 22:45:16 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 22:45:16.962095 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a57a7402-ba02-4726-9799-b5a9c34f7b5f tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Calling method '.version_select at 0x7fbbcc168280>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:17.014655 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-a57a7402-ba02-4726-9799-b5a9c34f7b5f tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] HTTP exception thrown: Volume 66548a39-b92d-40ef-84e5-3462723bf121 could not be found. Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a57a7402-ba02-4726-9799-b5a9c34f7b5f tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Request method failure captured: Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/os-volumes/66548a39-b92d-40ef-84e5-3462723bf121 HTTP/1.1 Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz8tlYVjsqGNQ4i4k7y5ZC2LCAxNBKSKf_UqabB5OsLE_lK5sK1dSiIbwwSOOz0FoppefBCMOM2Q42_gP_LbmeyhAhOuyAHv1MJkIULaeyM2W2wNYdEswTcBgDbSTU8wlirasaIPo5fYcUyhNNg5TcfhroocGulnf_CJ5_Jzn3RTmI Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:45:17.017448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_34d816bb36c34ae0ad52cfda34b3fa80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: da5d0201777c49369b1bab15101b3053 Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Volume 66548a39-b92d-40ef-84e5-3462723bf121 could not be found. Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '66548a39-b92d-40ef-84e5-3462723bf121'} Jun 23 22:45:17.018583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66548a39-b92d-40ef-84e5-3462723bf121 could not be found. (HTTP 404) (Request-ID: req-88873b56-487d-4ba2-b809-96e61042a00b) Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:17.019479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:45:17.020412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66548a39-b92d-40ef-84e5-3462723bf121 could not be found. Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 22:45:17.032721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66548a39-b92d-40ef-84e5-3462723bf121 could not be found. Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66548a39-b92d-40ef-84e5-3462723bf121 could not be found. Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a57a7402-ba02-4726-9799-b5a9c34f7b5f tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Returning 404 to user: Volume 66548a39-b92d-40ef-84e5-3462723bf121 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a57a7402-ba02-4726-9799-b5a9c34f7b5f tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/66548a39-b92d-40ef-84e5-3462723bf121" status: 404 len: 109 microversion: 2.1 time: 0.070673 Jun 23 22:45:17.034179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 17/25] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:45:16 2022] DELETE /compute/v2.1/os-volumes/66548a39-b92d-40ef-84e5-3462723bf121 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:45:17.035884 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dfde7c67-7e9c-47ee-9efa-3eb67dd63f0e tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Calling method '.version_select at 0x7fbbcc1659d0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:17.089116 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9ef6ef5f-03fc-481b-945f-3a0a3172dc68 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.789757 Jun 23 22:45:17.095087 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 9/26] 10.222.0.33 () {62 vars in 1199 bytes} [Thu Jun 23 22:45:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 793 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 22:45:17.124023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-dfde7c67-7e9c-47ee-9efa-3eb67dd63f0e tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] HTTP exception thrown: Volume 241cb68d-2692-4837-be54-4a63350f9586 could not be found. Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dfde7c67-7e9c-47ee-9efa-3eb67dd63f0e tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Request method failure captured: Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/os-volumes/241cb68d-2692-4837-be54-4a63350f9586 HTTP/1.1 Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz8tlYVjsqGNQ4i4k7y5ZC2LCAxNBKSKf_UqabB5OsLE_lK5sK1dSiIbwwSOOz0FoppefBCMOM2Q42_gP_LbmeyhAhOuyAHv1MJkIULaeyM2W2wNYdEswTcBgDbSTU8wlirasaIPo5fYcUyhNNg5TcfhroocGulnf_CJ5_Jzn3RTmI Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:45:17.125629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_34d816bb36c34ae0ad52cfda34b3fa80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/34d816bb36c34ae0ad52cfda34b3fa80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 34d816bb36c34ae0ad52cfda34b3fa80 Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesNegativeTest-2131387978 Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: da5d0201777c49369b1bab15101b3053 Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesNegativeTest-2131387978-project Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Volume 241cb68d-2692-4837-be54-4a63350f9586 could not be found. Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '241cb68d-2692-4837-be54-4a63350f9586'} Jun 23 22:45:17.126690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 241cb68d-2692-4837-be54-4a63350f9586 could not be found. (HTTP 404) (Request-ID: req-3339767c-afed-4b3a-a4d8-b02ab8568dcc) Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:17.127497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:45:17.128533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 241cb68d-2692-4837-be54-4a63350f9586 could not be found. Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 22:45:17.129487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 241cb68d-2692-4837-be54-4a63350f9586 could not be found. Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 241cb68d-2692-4837-be54-4a63350f9586 could not be found. Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dfde7c67-7e9c-47ee-9efa-3eb67dd63f0e tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] Returning 404 to user: Volume 241cb68d-2692-4837-be54-4a63350f9586 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dfde7c67-7e9c-47ee-9efa-3eb67dd63f0e tempest-VolumesNegativeTest-2131387978 tempest-VolumesNegativeTest-2131387978-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/241cb68d-2692-4837-be54-4a63350f9586" status: 404 len: 109 microversion: 2.1 time: 0.100567 Jun 23 22:45:17.130466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 18/27] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:45:17 2022] GET /compute/v2.1/os-volumes/241cb68d-2692-4837-be54-4a63350f9586 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:45:24.810791 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1000637319", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3508be72-eea9-4318-a47b-fd952236da0b"}], "security_groups": [{"name": "tempest-securitygroup--824943951"}], "key_name": "tempest-keypair-1967843072", "user_data": "}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:25.102375 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.network.neutron [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] validate_networks() for [('3508be72-eea9-4318-a47b-fd952236da0b', None, None, None, None, None)] {{(pid=124724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:45:26.679053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-570968651", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:26.817789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] validate_networks() for [('1602f0df-e0bd-4528-bb35-867b37bcef4f', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:45:26.903246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=4 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:27.686369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Flavor limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:45:27.686800 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Image limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:45:27.687437 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Flavor pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:45:27.688129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Image pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:45:27.688654 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:45:27.707578 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:27.708800 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:27.711644 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:27.712568 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:27.763200 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Getting quotas for project 13b00f92bcc449daadba8838f4c87a62. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:27.767669 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Getting quotas for user 5107e87ee4c34ef9ac96fa4a3a899bda and project 13b00f92bcc449daadba8838f4c87a62. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:27.793521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Going to run 1 instances... {{(pid=124724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:45:27.796306 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:45:27.956617 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-590ecb1c-5438-48f7-b5a2-e6ef72403651 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.151637 Jun 23 22:45:27.962761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 10/28] 10.222.0.33 () {62 vars in 1187 bytes} [Thu Jun 23 22:45:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 3157 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 23 22:45:28.317157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:45:28.318087 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:45:28.318696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:45:28.319243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:45:28.319975 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:45:28.334376 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:28.335053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:28.335834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:28.336264 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:28.365933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Getting quotas for project 19ed20d55acb41fcb18006919476bf80. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:28.373782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Getting quotas for user 675d117397da452faa5221af0906fb12 and project 19ed20d55acb41fcb18006919476bf80. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:28.414499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:45:28.417348 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:45:28.619177 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bbaa4677-03a5-4876-b01b-70e533d009a0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.484897 Jun 23 22:45:28.624930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 19/29] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:45:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:45:28.696445 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0ed5956a-93fa-4a4a-9e9e-e9656c14b6c5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: .version_select at 0x7fbbcb886940>, body: {"keypair": {"name": "tempest-keypair-78893719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6SdbjDVpcgN/FzuZC9TP17AE+M5Dmlfx1YYy4gWRjPKDveyiWfAHWOJVUsEqks9Eq41qDs1n8Tmlje+I0uU4j9eInmlpd9ibcdMZN+ShN2Zomv/X4MPAtBwxydp+KAzQ=="}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:28.804837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-0ed5956a-93fa-4a4a-9e9e-e9656c14b6c5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:28.815068 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-0ed5956a-93fa-4a4a-9e9e-e9656c14b6c5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for user 1d7e431402f8433fb7565f69103485ce and project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:28.919983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0ed5956a-93fa-4a4a-9e9e-e9656c14b6c5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.958053 Jun 23 22:45:28.920872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 11/30] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:45:27 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:28.925934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-dd318f53-880b-4fb8-9e52-2a1acd42d1e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:28.926667 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-dd318f53-880b-4fb8-9e52-2a1acd42d1e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:29.016367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-dd318f53-880b-4fb8-9e52-2a1acd42d1e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:29.031079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-dd318f53-880b-4fb8-9e52-2a1acd42d1e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:29.032652 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-dd318f53-880b-4fb8-9e52-2a1acd42d1e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:29.033782 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-dd318f53-880b-4fb8-9e52-2a1acd42d1e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1282 microversion: 2.20 time: 0.111774 Jun 23 22:45:29.034336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 12/31] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:28 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1282 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:29.040353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-390c949d-166c-4d73-8165-3b15c9238a8c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:29.040353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-390c949d-166c-4d73-8165-3b15c9238a8c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:29.131349 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-390c949d-166c-4d73-8165-3b15c9238a8c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:29.142256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-390c949d-166c-4d73-8165-3b15c9238a8c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1221 microversion: 2.1 time: 0.106462 Jun 23 22:45:29.143389 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 13/32] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:29 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:29.395603 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-655079821", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "networks": [{"uuid": "d07418da-2115-4d01-bdcb-4b99e0e2da83"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:29.462693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] validate_networks() for [('d07418da-2115-4d01-bdcb-4b99e0e2da83', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:45:29.819354 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-795192478", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:30.007373 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.network.neutron [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] validate_networks() for [('1602f0df-e0bd-4528-bb35-867b37bcef4f', None, None, None, None, None)] {{(pid=124724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:45:30.532295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:45:30.532838 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:45:30.533486 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:45:30.535134 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:45:30.535996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:45:30.554568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:30.555094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:30.558383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:30.567796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:30.642536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Getting quotas for project a35daf906b2e442c9b27cb6f83673f0a. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:30.669977 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Getting quotas for user 365b889f8f1a4c5dad09364e5df705ba and project a35daf906b2e442c9b27cb6f83673f0a. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:30.714769 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:45:30.726619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:45:30.988902 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d2c51fc4-3d7c-4005-b0f7-f4709ac8978f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.362738 Jun 23 22:45:30.993229 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 20/33] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:45:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:45:31.004616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a5eb46c4-c14c-4169-8bfa-d949c71a3d05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:31.007913 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a5eb46c4-c14c-4169-8bfa-d949c71a3d05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:31.403886 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a5eb46c4-c14c-4169-8bfa-d949c71a3d05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:31.458440 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a5eb46c4-c14c-4169-8bfa-d949c71a3d05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:31.458891 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a5eb46c4-c14c-4169-8bfa-d949c71a3d05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:31.460330 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a5eb46c4-c14c-4169-8bfa-d949c71a3d05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1282 microversion: 2.20 time: 0.465634 Jun 23 22:45:31.465732 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 21/34] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:30 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1282 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:31.491806 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-860d6f0d-b333-493a-a3a1-85217959caaa tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:31.498770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-860d6f0d-b333-493a-a3a1-85217959caaa tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:31.549129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Flavor limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:45:31.549635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Image limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:45:31.550218 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Flavor pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:45:31.550622 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Image pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:45:31.551028 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:45:31.565254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:31.565712 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:31.566498 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:31.566934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:31.659913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Getting quotas for project 19ed20d55acb41fcb18006919476bf80. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:31.680008 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Getting quotas for user 675d117397da452faa5221af0906fb12 and project 19ed20d55acb41fcb18006919476bf80. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:31.722598 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Going to run 1 instances... {{(pid=124724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:45:31.740204 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:45:31.895418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-860d6f0d-b333-493a-a3a1-85217959caaa tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:31.912363 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-860d6f0d-b333-493a-a3a1-85217959caaa tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1214 microversion: 2.1 time: 0.443801 Jun 23 22:45:31.915413 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 22/35] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:31 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1214 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:31.988599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ec3bf7eb-6e45-4429-be98-03acccdfa966 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.173224 Jun 23 22:45:31.990634 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 14/36] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:45:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 22:45:32.007596 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-01cbe324-37ca-4a91-8ec2-10e1a35c628f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:32.008682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-01cbe324-37ca-4a91-8ec2-10e1a35c628f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:32.164443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-01cbe324-37ca-4a91-8ec2-10e1a35c628f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:32.174483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-01cbe324-37ca-4a91-8ec2-10e1a35c628f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1221 microversion: 2.1 time: 0.171474 Jun 23 22:45:32.177181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 23/37] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:32 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1221 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:32.491927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:32.492790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:32.506338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:32.509738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:32.513977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:32.513977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:32.919747 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:32.951982 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7d949c79-2132-4429-8e7c-d5e9209d17ec tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:32.953905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7d949c79-2132-4429-8e7c-d5e9209d17ec tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:32.976784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:32.987468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:32.990830 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-edec5fa0-1d74-48da-a3b5-288626f9d1c6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1286 microversion: 2.20 time: 0.511776 Jun 23 22:45:32.995616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 15/38] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:32 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1286 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:33.199000 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e3f51fdd-eaeb-404f-80f0-538c08b70790 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:33.199672 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e3f51fdd-eaeb-404f-80f0-538c08b70790 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:33.259392 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7d949c79-2132-4429-8e7c-d5e9209d17ec tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:33.278543 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7d949c79-2132-4429-8e7c-d5e9209d17ec tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1214 microversion: 2.1 time: 0.348067 Jun 23 22:45:33.284454 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 24/39] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:32 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1214 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:33.394814 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e3f51fdd-eaeb-404f-80f0-538c08b70790 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:33.404715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e3f51fdd-eaeb-404f-80f0-538c08b70790 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1221 microversion: 2.1 time: 0.213567 Jun 23 22:45:33.411314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 16/40] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:33 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:34.011248 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:34.013692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:34.029539 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.031674 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.034686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.036332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.297437 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-caadb84c-d26a-4f50-bdc6-782ea665bd45 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:34.299983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-caadb84c-d26a-4f50-bdc6-782ea665bd45 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:34.311022 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:34.333273 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-caadb84c-d26a-4f50-bdc6-782ea665bd45 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.333737 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-caadb84c-d26a-4f50-bdc6-782ea665bd45 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.335686 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-caadb84c-d26a-4f50-bdc6-782ea665bd45 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.338614 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-caadb84c-d26a-4f50-bdc6-782ea665bd45 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.344380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:34.352620 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:34.353841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d92be788-8b17-47dc-bbac-aaf10cc9faf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1334 microversion: 2.20 time: 0.347914 Jun 23 22:45:34.363834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 25/41] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:34 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1334 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:34.369645 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1929633341", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c28b5ed-da0d-4ee9-8621-fe10ec1946bf"}], "security_groups": [{"name": "tempest-securitygroup--1197368244"}], "key_name": "tempest-keypair-78893719", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:34.441059 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-caadb84c-d26a-4f50-bdc6-782ea665bd45 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:34.451149 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-caadb84c-d26a-4f50-bdc6-782ea665bd45 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1210 microversion: 2.1 time: 0.155459 Jun 23 22:45:34.453064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 17/42] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:34 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:34.470781 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6717a249-2b81-4ead-ac24-607776f23504 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:34.471406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6717a249-2b81-4ead-ac24-607776f23504 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:34.477717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6717a249-2b81-4ead-ac24-607776f23504 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.478211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6717a249-2b81-4ead-ac24-607776f23504 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.478982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6717a249-2b81-4ead-ac24-607776f23504 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:34.479786 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6717a249-2b81-4ead-ac24-607776f23504 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:34.563944 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6717a249-2b81-4ead-ac24-607776f23504 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:34.593575 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6717a249-2b81-4ead-ac24-607776f23504 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1217 microversion: 2.1 time: 0.137468 Jun 23 22:45:34.596982 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] validate_networks() for [('3c28b5ed-da0d-4ee9-8621-fe10ec1946bf', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:45:34.602592 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 18/43] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:34 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:35.203978 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:45:35.205060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:45:35.205540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:45:35.205948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:45:35.206358 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:45:35.217442 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.218288 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.219096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.219440 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.242049 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:45:35.246239 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for user 1d7e431402f8433fb7565f69103485ce and project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:45:35.264937 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:45:35.268343 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:45:35.391053 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:35.391053 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:35.421774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.422474 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.423673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.424386 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.432538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9cdc20a6-9c18-4103-a5ca-c6fac6dbfa0e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.074643 Jun 23 22:45:35.439369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 26/44] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:45:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:45:35.446787 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a1330ac3-3f88-42e8-8d15-d8d4405bf7be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:35.447421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a1330ac3-3f88-42e8-8d15-d8d4405bf7be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:35.558136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a1330ac3-3f88-42e8-8d15-d8d4405bf7be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:35.571666 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a1330ac3-3f88-42e8-8d15-d8d4405bf7be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1240 microversion: 2.1 time: 0.130999 Jun 23 22:45:35.574298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 27/45] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:35 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1240 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:35.583601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:35.598741 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4e793555-33e7-473c-a5f1-b77f7628e38f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:35.598741 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4e793555-33e7-473c-a5f1-b77f7628e38f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:35.600548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:35.602084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:35.603199 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b1a8fa9a-325f-4c8e-9c85-62d96f506dca tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1334 microversion: 2.20 time: 0.225832 Jun 23 22:45:35.609560 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 19/46] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:35 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1334 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:35.616823 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e793555-33e7-473c-a5f1-b77f7628e38f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.618185 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e793555-33e7-473c-a5f1-b77f7628e38f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.621528 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e793555-33e7-473c-a5f1-b77f7628e38f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.622237 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e793555-33e7-473c-a5f1-b77f7628e38f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.630186 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-dabd272c-cf09-43c8-9cda-a3832fcb0483 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:35.630186 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-dabd272c-cf09-43c8-9cda-a3832fcb0483 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:35.632706 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dabd272c-cf09-43c8-9cda-a3832fcb0483 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.633326 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dabd272c-cf09-43c8-9cda-a3832fcb0483 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.634690 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dabd272c-cf09-43c8-9cda-a3832fcb0483 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:35.635533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dabd272c-cf09-43c8-9cda-a3832fcb0483 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:35.702035 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4e793555-33e7-473c-a5f1-b77f7628e38f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:35.711510 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4e793555-33e7-473c-a5f1-b77f7628e38f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1210 microversion: 2.1 time: 0.123816 Jun 23 22:45:35.712463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 28/47] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:35 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:35.742612 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-dabd272c-cf09-43c8-9cda-a3832fcb0483 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:35.751755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-dabd272c-cf09-43c8-9cda-a3832fcb0483 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1217 microversion: 2.1 time: 0.133307 Jun 23 22:45:35.752421 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 20/48] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:35 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1217 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:36.590646 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8ec59575-4f81-4c6d-808b-f3cebe942675 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:36.591382 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8ec59575-4f81-4c6d-808b-f3cebe942675 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:36.624540 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:36.625503 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:36.652681 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:36.656865 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:36.658010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:36.660567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:36.676658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8ec59575-4f81-4c6d-808b-f3cebe942675 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:36.684505 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8ec59575-4f81-4c6d-808b-f3cebe942675 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1240 microversion: 2.1 time: 0.097705 Jun 23 22:45:36.685117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 29/49] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:36 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1240 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:36.729289 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9de4e2b9-50e2-4ba7-b656-5031261b5bd1 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:36.729916 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9de4e2b9-50e2-4ba7-b656-5031261b5bd1 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:36.738725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9de4e2b9-50e2-4ba7-b656-5031261b5bd1 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:36.740880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9de4e2b9-50e2-4ba7-b656-5031261b5bd1 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:36.748346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9de4e2b9-50e2-4ba7-b656-5031261b5bd1 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:36.748346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9de4e2b9-50e2-4ba7-b656-5031261b5bd1 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:36.806417 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:36.816092 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:36.818347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:36.820568 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5433a13b-4b94-41d0-8868-0a10082ce5a7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1334 microversion: 2.20 time: 0.200594 Jun 23 22:45:36.821410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 21/50] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:36 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1334 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:36.827378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-715bd129-1d10-4ccc-ba61-6942f06d7a76 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:36.828164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-715bd129-1d10-4ccc-ba61-6942f06d7a76 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:36.837085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-715bd129-1d10-4ccc-ba61-6942f06d7a76 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:36.837843 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-715bd129-1d10-4ccc-ba61-6942f06d7a76 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:36.839898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-715bd129-1d10-4ccc-ba61-6942f06d7a76 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:36.840569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-715bd129-1d10-4ccc-ba61-6942f06d7a76 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:36.864485 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9de4e2b9-50e2-4ba7-b656-5031261b5bd1 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:36.876612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9de4e2b9-50e2-4ba7-b656-5031261b5bd1 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1210 microversion: 2.1 time: 0.151554 Jun 23 22:45:36.886937 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 30/51] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:36 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:36.951228 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-715bd129-1d10-4ccc-ba61-6942f06d7a76 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:36.959190 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-715bd129-1d10-4ccc-ba61-6942f06d7a76 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1217 microversion: 2.1 time: 0.136290 Jun 23 22:45:36.960144 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 22/52] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:36 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1217 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:37.702917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-01541dcf-ccb5-4168-a0ab-b5879ed43c2c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:37.703551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-01541dcf-ccb5-4168-a0ab-b5879ed43c2c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:37.713257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-01541dcf-ccb5-4168-a0ab-b5879ed43c2c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:37.715607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-01541dcf-ccb5-4168-a0ab-b5879ed43c2c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:37.718009 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-01541dcf-ccb5-4168-a0ab-b5879ed43c2c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:37.718807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-01541dcf-ccb5-4168-a0ab-b5879ed43c2c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:37.840491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:37.841808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:37.854075 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:37.854901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:37.855976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:37.856645 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:37.938209 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-01541dcf-ccb5-4168-a0ab-b5879ed43c2c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:37.981965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-01541dcf-ccb5-4168-a0ab-b5879ed43c2c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1236 microversion: 2.1 time: 0.281940 Jun 23 22:45:37.993315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:37.996107 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 31/53] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:37 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1236 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:38.008701 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:38.011191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:38.013098 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eccfddc7-c709-4c83-9c9d-c02a2fdb01f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:38.015154 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6678f37e-11b2-484f-bfc0-c07ccf39c043 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1340 microversion: 2.20 time: 0.179540 Jun 23 22:45:38.015754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-eccfddc7-c709-4c83-9c9d-c02a2fdb01f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:38.029573 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 23/54] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:37 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1340 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:38.036651 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eccfddc7-c709-4c83-9c9d-c02a2fdb01f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:38.037304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eccfddc7-c709-4c83-9c9d-c02a2fdb01f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:38.038235 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eccfddc7-c709-4c83-9c9d-c02a2fdb01f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:38.038817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eccfddc7-c709-4c83-9c9d-c02a2fdb01f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:38.046930 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-27aaa9c3-6f11-432d-b3e3-32fde9a95889 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:38.047865 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-27aaa9c3-6f11-432d-b3e3-32fde9a95889 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:38.065462 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-27aaa9c3-6f11-432d-b3e3-32fde9a95889 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:38.066146 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-27aaa9c3-6f11-432d-b3e3-32fde9a95889 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:38.067128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-27aaa9c3-6f11-432d-b3e3-32fde9a95889 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:38.067716 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-27aaa9c3-6f11-432d-b3e3-32fde9a95889 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:38.240627 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-27aaa9c3-6f11-432d-b3e3-32fde9a95889 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:38.253575 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-27aaa9c3-6f11-432d-b3e3-32fde9a95889 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1281 microversion: 2.1 time: 0.222724 Jun 23 22:45:38.264088 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 24/55] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:38 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:38.314055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-eccfddc7-c709-4c83-9c9d-c02a2fdb01f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:38.333908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-eccfddc7-c709-4c83-9c9d-c02a2fdb01f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1284 microversion: 2.1 time: 0.336257 Jun 23 22:45:38.337084 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 32/56] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:37 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:39.030005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-efe250ac-0a81-4301-9fe7-b94a4b77b356 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:39.030005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-efe250ac-0a81-4301-9fe7-b94a4b77b356 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:39.030005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-efe250ac-0a81-4301-9fe7-b94a4b77b356 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:39.030005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-efe250ac-0a81-4301-9fe7-b94a4b77b356 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:39.030829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-efe250ac-0a81-4301-9fe7-b94a4b77b356 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:39.030829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-efe250ac-0a81-4301-9fe7-b94a4b77b356 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:39.040504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:39.042580 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:39.049852 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:39.050394 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:39.051277 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:39.051946 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:39.171735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:39.183403 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:39.185715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:39.187168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9d870f03-d39d-4234-a0eb-2b72bd9062ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1340 microversion: 2.20 time: 0.151909 Jun 23 22:45:39.188998 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 33/57] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:39 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1340 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:39.262825 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-efe250ac-0a81-4301-9fe7-b94a4b77b356 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:39.270605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-efe250ac-0a81-4301-9fe7-b94a4b77b356 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.275067 Jun 23 22:45:39.271169 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 25/58] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:38 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:39.294168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0d5631ae-696a-4bc5-9f2a-9db63446d322 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:39.294787 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0d5631ae-696a-4bc5-9f2a-9db63446d322 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:39.300969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d5631ae-696a-4bc5-9f2a-9db63446d322 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:39.301416 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d5631ae-696a-4bc5-9f2a-9db63446d322 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:39.302190 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d5631ae-696a-4bc5-9f2a-9db63446d322 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:39.302626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d5631ae-696a-4bc5-9f2a-9db63446d322 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:39.351498 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c8584d23-54ed-4545-95b1-c85173ac2164 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:39.352113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c8584d23-54ed-4545-95b1-c85173ac2164 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:39.354036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:39.358990 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c8584d23-54ed-4545-95b1-c85173ac2164 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:39.359485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c8584d23-54ed-4545-95b1-c85173ac2164 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:39.360256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c8584d23-54ed-4545-95b1-c85173ac2164 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:39.360763 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c8584d23-54ed-4545-95b1-c85173ac2164 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:39.363150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d5631ae-696a-4bc5-9f2a-9db63446d322 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:39.370988 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0d5631ae-696a-4bc5-9f2a-9db63446d322 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1281 microversion: 2.1 time: 0.081066 Jun 23 22:45:39.371600 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 34/59] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:39 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:39.421511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c8584d23-54ed-4545-95b1-c85173ac2164 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:39.428962 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c8584d23-54ed-4545-95b1-c85173ac2164 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1272 microversion: 2.1 time: 0.081299 Jun 23 22:45:39.429530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 26/60] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:39 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:40.207055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:40.207665 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:40.214359 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:40.214995 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:40.215760 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:40.216194 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:40.278160 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:40.286560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:40.288090 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:40.289112 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3953314a-0b28-4f96-8a7a-c1223e62e95c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:40.289587 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f16cf3ec-d6e2-41e8-9d72-b458dfbc6e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1340 microversion: 2.20 time: 0.086056 Jun 23 22:45:40.289763 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 35/61] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:40 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1340 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:40.291123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3953314a-0b28-4f96-8a7a-c1223e62e95c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:40.297232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3953314a-0b28-4f96-8a7a-c1223e62e95c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:40.297752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3953314a-0b28-4f96-8a7a-c1223e62e95c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:40.298580 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3953314a-0b28-4f96-8a7a-c1223e62e95c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:40.299083 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3953314a-0b28-4f96-8a7a-c1223e62e95c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:40.358000 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3953314a-0b28-4f96-8a7a-c1223e62e95c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:40.365315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3953314a-0b28-4f96-8a7a-c1223e62e95c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.080369 Jun 23 22:45:40.365867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 27/62] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:40 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:40.387673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6eade52d-9aba-436f-8b87-96850976f464 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:40.388216 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6eade52d-9aba-436f-8b87-96850976f464 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:40.394296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eade52d-9aba-436f-8b87-96850976f464 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:40.394811 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eade52d-9aba-436f-8b87-96850976f464 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:40.395571 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eade52d-9aba-436f-8b87-96850976f464 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:40.395998 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6eade52d-9aba-436f-8b87-96850976f464 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:40.446200 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c2612517-c7af-450d-a4e6-61b204838ec3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:40.446951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c2612517-c7af-450d-a4e6-61b204838ec3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:40.453602 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2612517-c7af-450d-a4e6-61b204838ec3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:40.454122 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2612517-c7af-450d-a4e6-61b204838ec3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:40.455110 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2612517-c7af-450d-a4e6-61b204838ec3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:40.455532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2612517-c7af-450d-a4e6-61b204838ec3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:40.457629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6eade52d-9aba-436f-8b87-96850976f464 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:40.465738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6eade52d-9aba-436f-8b87-96850976f464 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1281 microversion: 2.1 time: 0.082489 Jun 23 22:45:40.466530 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 36/63] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:40 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:40.516567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c2612517-c7af-450d-a4e6-61b204838ec3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:40.523905 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c2612517-c7af-450d-a4e6-61b204838ec3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1272 microversion: 2.1 time: 0.081653 Jun 23 22:45:40.524460 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 28/64] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:40 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1272 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:41.308545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:41.312036 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:41.330171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:41.330171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:41.330171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:41.330171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:41.387320 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d6dba810-8a5e-41e2-8374-efdab5c1bec9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:41.388685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d6dba810-8a5e-41e2-8374-efdab5c1bec9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:41.412366 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d6dba810-8a5e-41e2-8374-efdab5c1bec9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:41.414132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d6dba810-8a5e-41e2-8374-efdab5c1bec9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:41.418362 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d6dba810-8a5e-41e2-8374-efdab5c1bec9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:41.418832 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d6dba810-8a5e-41e2-8374-efdab5c1bec9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:41.553179 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d6dba810-8a5e-41e2-8374-efdab5c1bec9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:41.564403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d6dba810-8a5e-41e2-8374-efdab5c1bec9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.185098 Jun 23 22:45:41.565624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 29/65] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:41 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:41.571481 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b545e3b2-59aa-4cd5-aa31-0a2a19a9d82d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:41.572415 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b545e3b2-59aa-4cd5-aa31-0a2a19a9d82d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:41.584707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b545e3b2-59aa-4cd5-aa31-0a2a19a9d82d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:41.585364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b545e3b2-59aa-4cd5-aa31-0a2a19a9d82d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:41.587395 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b545e3b2-59aa-4cd5-aa31-0a2a19a9d82d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:41.605237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b545e3b2-59aa-4cd5-aa31-0a2a19a9d82d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:41.620677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=4 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:41.767833 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:41.776933 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b545e3b2-59aa-4cd5-aa31-0a2a19a9d82d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:41.788410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:41.792880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:41.795603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b545e3b2-59aa-4cd5-aa31-0a2a19a9d82d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1291 microversion: 2.1 time: 0.228319 Jun 23 22:45:41.796199 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 30/66] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:41 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1291 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:41.800058 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4631cba4-657f-442e-ae6d-69127667e32d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.496493 Jun 23 22:45:41.811471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 37/67] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:41 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:41.811874 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-605fbb48-4e66-4277-8fd4-2062b9aa7055 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:41.811874 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-605fbb48-4e66-4277-8fd4-2062b9aa7055 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:41.811874 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-605fbb48-4e66-4277-8fd4-2062b9aa7055 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:41.811874 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-605fbb48-4e66-4277-8fd4-2062b9aa7055 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:41.812188 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-605fbb48-4e66-4277-8fd4-2062b9aa7055 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:41.812188 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-605fbb48-4e66-4277-8fd4-2062b9aa7055 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:41.980375 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-605fbb48-4e66-4277-8fd4-2062b9aa7055 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:41.983904 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:41.988168 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-605fbb48-4e66-4277-8fd4-2062b9aa7055 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.190999 Jun 23 22:45:41.991506 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 31/68] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:41 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:42.584035 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-703a2279-63d9-4dad-ad0b-7fdd10aa9d54 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:42.585339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-703a2279-63d9-4dad-ad0b-7fdd10aa9d54 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:42.592412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-703a2279-63d9-4dad-ad0b-7fdd10aa9d54 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:42.592903 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-703a2279-63d9-4dad-ad0b-7fdd10aa9d54 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:42.593665 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-703a2279-63d9-4dad-ad0b-7fdd10aa9d54 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:42.594104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-703a2279-63d9-4dad-ad0b-7fdd10aa9d54 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:42.655823 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-703a2279-63d9-4dad-ad0b-7fdd10aa9d54 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:42.663341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-703a2279-63d9-4dad-ad0b-7fdd10aa9d54 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.083214 Jun 23 22:45:42.664115 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 38/69] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:42 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:42.815433 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-69bc170b-f52d-4acf-8d47-3e91c037c7ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:42.816083 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-69bc170b-f52d-4acf-8d47-3e91c037c7ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:42.818575 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:42.819181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:42.823403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-69bc170b-f52d-4acf-8d47-3e91c037c7ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:42.824049 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-69bc170b-f52d-4acf-8d47-3e91c037c7ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:42.824845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-69bc170b-f52d-4acf-8d47-3e91c037c7ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:42.825277 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-69bc170b-f52d-4acf-8d47-3e91c037c7ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:42.825759 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:42.826202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:42.826971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:42.827369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:42.889912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-69bc170b-f52d-4acf-8d47-3e91c037c7ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:42.905671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-69bc170b-f52d-4acf-8d47-3e91c037c7ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1291 microversion: 2.1 time: 0.085861 Jun 23 22:45:42.905671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 32/70] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:42 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1291 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:42.957076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:42.965785 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:42.967369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:42.968471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-309e05ad-a740-4a9f-8522-ab26cb0acb18 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.153707 Jun 23 22:45:42.969052 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 39/71] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:42 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:43.006133 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-77b2e16e-8493-4d33-bb8b-cc1d2980f599 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:43.006740 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-77b2e16e-8493-4d33-bb8b-cc1d2980f599 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:43.013469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-77b2e16e-8493-4d33-bb8b-cc1d2980f599 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:43.020387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-77b2e16e-8493-4d33-bb8b-cc1d2980f599 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:43.020387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-77b2e16e-8493-4d33-bb8b-cc1d2980f599 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:43.020387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-77b2e16e-8493-4d33-bb8b-cc1d2980f599 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:43.154273 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-77b2e16e-8493-4d33-bb8b-cc1d2980f599 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:43.165487 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-77b2e16e-8493-4d33-bb8b-cc1d2980f599 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.163167 Jun 23 22:45:43.167157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 33/72] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:43 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:43.682611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-96c98281-c7f7-47db-be79-39f201d6c2a4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:43.683529 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-96c98281-c7f7-47db-be79-39f201d6c2a4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:43.686581 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:43.690021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96c98281-c7f7-47db-be79-39f201d6c2a4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:43.690473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96c98281-c7f7-47db-be79-39f201d6c2a4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:43.691261 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96c98281-c7f7-47db-be79-39f201d6c2a4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:43.691744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96c98281-c7f7-47db-be79-39f201d6c2a4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:43.753179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-96c98281-c7f7-47db-be79-39f201d6c2a4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:43.761604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-96c98281-c7f7-47db-be79-39f201d6c2a4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.084044 Jun 23 22:45:43.762167 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 40/73] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:43 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:43.914780 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-800b2083-83c9-4966-b1b3-d2a1d6760b20 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:43.916801 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-800b2083-83c9-4966-b1b3-d2a1d6760b20 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:43.918854 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=22 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:43.925237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-800b2083-83c9-4966-b1b3-d2a1d6760b20 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:43.928765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-800b2083-83c9-4966-b1b3-d2a1d6760b20 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:43.936771 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-800b2083-83c9-4966-b1b3-d2a1d6760b20 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:43.937285 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-800b2083-83c9-4966-b1b3-d2a1d6760b20 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:43.987299 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:43.989911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:44.002150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:44.002805 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:44.003746 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:44.004268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:44.027173 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-800b2083-83c9-4966-b1b3-d2a1d6760b20 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:44.034894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-800b2083-83c9-4966-b1b3-d2a1d6760b20 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1291 microversion: 2.1 time: 0.123858 Jun 23 22:45:44.045689 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 34/74] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:43 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1291 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:44.162576 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:44.171473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:44.174700 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:44.176008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4744ef74-79e2-4910-a5ed-e14c0243bd4b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.192662 Jun 23 22:45:44.177054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 41/75] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:43 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:44.183854 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-47013006-bb6c-4972-9e2b-9544e2cd2f62 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:44.185073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-47013006-bb6c-4972-9e2b-9544e2cd2f62 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:44.193700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47013006-bb6c-4972-9e2b-9544e2cd2f62 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:44.194233 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47013006-bb6c-4972-9e2b-9544e2cd2f62 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:44.195364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47013006-bb6c-4972-9e2b-9544e2cd2f62 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:44.195931 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47013006-bb6c-4972-9e2b-9544e2cd2f62 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:44.421726 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-47013006-bb6c-4972-9e2b-9544e2cd2f62 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:44.448198 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-47013006-bb6c-4972-9e2b-9544e2cd2f62 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.263501 Jun 23 22:45:44.449937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 35/76] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:44 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:44.779667 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5c12e289-76d6-446d-8b99-865941d328e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:44.781178 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c12e289-76d6-446d-8b99-865941d328e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:44.789069 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c12e289-76d6-446d-8b99-865941d328e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:44.791619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c12e289-76d6-446d-8b99-865941d328e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:44.791619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c12e289-76d6-446d-8b99-865941d328e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:44.792348 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c12e289-76d6-446d-8b99-865941d328e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:44.877509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5c12e289-76d6-446d-8b99-865941d328e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:44.886494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5c12e289-76d6-446d-8b99-865941d328e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.111980 Jun 23 22:45:44.887063 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 42/77] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:44 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:45.053770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6caac41c-f19c-4533-b74e-5ac7c149cf8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:45.055097 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6caac41c-f19c-4533-b74e-5ac7c149cf8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:45.069868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6caac41c-f19c-4533-b74e-5ac7c149cf8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:45.070499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6caac41c-f19c-4533-b74e-5ac7c149cf8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:45.071435 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6caac41c-f19c-4533-b74e-5ac7c149cf8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:45.081708 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6caac41c-f19c-4533-b74e-5ac7c149cf8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:45.177673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6caac41c-f19c-4533-b74e-5ac7c149cf8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:45.198723 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:45.199335 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:45.200881 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6caac41c-f19c-4533-b74e-5ac7c149cf8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1279 microversion: 2.1 time: 0.151199 Jun 23 22:45:45.201630 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 36/78] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:45 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:45.208993 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:45.300880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:45.300880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:45.300880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:45.300880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:45.300880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:45.466065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5518874b-ec9f-4cdd-979b-759603b76883 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:45.466667 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5518874b-ec9f-4cdd-979b-759603b76883 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:45.473619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5518874b-ec9f-4cdd-979b-759603b76883 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:45.474073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5518874b-ec9f-4cdd-979b-759603b76883 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:45.474896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5518874b-ec9f-4cdd-979b-759603b76883 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:45.475507 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5518874b-ec9f-4cdd-979b-759603b76883 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:45.484835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:45.495097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:45.496635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:45.498319 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-293fc1ea-d275-4c24-8da8-5f4872075df7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.307858 Jun 23 22:45:45.499443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 43/79] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:45 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:45.655796 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5518874b-ec9f-4cdd-979b-759603b76883 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:45.677614 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5518874b-ec9f-4cdd-979b-759603b76883 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.216044 Jun 23 22:45:45.689433 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 37/80] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:45 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:45.908042 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c84b5553-4c19-4d4c-8718-5e015f4401fc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:45.910296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c84b5553-4c19-4d4c-8718-5e015f4401fc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:45.918900 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c84b5553-4c19-4d4c-8718-5e015f4401fc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:45.919411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c84b5553-4c19-4d4c-8718-5e015f4401fc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:45.920428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c84b5553-4c19-4d4c-8718-5e015f4401fc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:45.920978 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c84b5553-4c19-4d4c-8718-5e015f4401fc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:45.988203 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c84b5553-4c19-4d4c-8718-5e015f4401fc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:45.997354 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c84b5553-4c19-4d4c-8718-5e015f4401fc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.097744 Jun 23 22:45:45.998494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 44/81] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:45 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:46.274679 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a987dd96-0333-4578-bb90-6674028a7217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:46.276949 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a987dd96-0333-4578-bb90-6674028a7217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:46.283997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a987dd96-0333-4578-bb90-6674028a7217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:46.284830 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a987dd96-0333-4578-bb90-6674028a7217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:46.285964 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a987dd96-0333-4578-bb90-6674028a7217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:46.286763 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a987dd96-0333-4578-bb90-6674028a7217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:46.366725 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a987dd96-0333-4578-bb90-6674028a7217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:46.388819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a987dd96-0333-4578-bb90-6674028a7217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1279 microversion: 2.1 time: 0.104506 Jun 23 22:45:46.388819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 38/82] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:46 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1279 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:46.518076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:46.518839 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:46.524911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:46.526622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:46.526982 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:46.527423 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:46.684433 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=30 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:46.695565 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ccd2a04a-cd7e-4791-9fb4-13245d4a3e25 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:46.698273 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ccd2a04a-cd7e-4791-9fb4-13245d4a3e25 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:46.706901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccd2a04a-cd7e-4791-9fb4-13245d4a3e25 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:46.707630 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccd2a04a-cd7e-4791-9fb4-13245d4a3e25 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:46.708620 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccd2a04a-cd7e-4791-9fb4-13245d4a3e25 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:46.709275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccd2a04a-cd7e-4791-9fb4-13245d4a3e25 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:46.710294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:46.720356 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:46.722091 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:46.725276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d5f0c12b-5957-4d65-a880-583989adacf6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.209834 Jun 23 22:45:46.725276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 45/83] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:46 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:46.860952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ccd2a04a-cd7e-4791-9fb4-13245d4a3e25 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:46.868743 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ccd2a04a-cd7e-4791-9fb4-13245d4a3e25 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.177430 Jun 23 22:45:46.869580 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 39/84] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:46 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:47.015471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-862c49c4-b6eb-46ac-b647-81074a917964 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:47.016154 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-862c49c4-b6eb-46ac-b647-81074a917964 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:47.023287 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-862c49c4-b6eb-46ac-b647-81074a917964 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.023754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-862c49c4-b6eb-46ac-b647-81074a917964 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.024598 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-862c49c4-b6eb-46ac-b647-81074a917964 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.025224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-862c49c4-b6eb-46ac-b647-81074a917964 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.097096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-862c49c4-b6eb-46ac-b647-81074a917964 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:47.098311 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-862c49c4-b6eb-46ac-b647-81074a917964 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.086938 Jun 23 22:45:47.098861 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 46/85] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:47 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:47.404896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1202d250-e9de-4ff5-8bc9-335f75f276d1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:47.404896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1202d250-e9de-4ff5-8bc9-335f75f276d1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:47.414170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1202d250-e9de-4ff5-8bc9-335f75f276d1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.415073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1202d250-e9de-4ff5-8bc9-335f75f276d1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.416696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1202d250-e9de-4ff5-8bc9-335f75f276d1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.417390 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1202d250-e9de-4ff5-8bc9-335f75f276d1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.483730 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1202d250-e9de-4ff5-8bc9-335f75f276d1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:47.491164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1202d250-e9de-4ff5-8bc9-335f75f276d1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1279 microversion: 2.1 time: 0.091606 Jun 23 22:45:47.491719 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 40/86] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:47 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:47.741306 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:47.742001 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:47.748354 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.748826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.749604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.750029 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.886976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4fde43cc-f2ca-419e-8fa0-010d55c88af5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:47.887693 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4fde43cc-f2ca-419e-8fa0-010d55c88af5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:47.894286 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4fde43cc-f2ca-419e-8fa0-010d55c88af5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.894834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4fde43cc-f2ca-419e-8fa0-010d55c88af5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.895136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:47.895777 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4fde43cc-f2ca-419e-8fa0-010d55c88af5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:47.896315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4fde43cc-f2ca-419e-8fa0-010d55c88af5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:47.904607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:47.908147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:47.909407 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6a58daf9-b78c-4b6b-98f4-8287891e1bf2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.172227 Jun 23 22:45:47.921537 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 47/87] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:47 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:48.054658 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4fde43cc-f2ca-419e-8fa0-010d55c88af5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:48.062522 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4fde43cc-f2ca-419e-8fa0-010d55c88af5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.179529 Jun 23 22:45:48.067414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 41/88] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:47 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:48.121552 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ec255b33-0fbe-4d60-8374-2e902fb8541d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:48.122134 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ec255b33-0fbe-4d60-8374-2e902fb8541d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:48.128830 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec255b33-0fbe-4d60-8374-2e902fb8541d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.129272 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec255b33-0fbe-4d60-8374-2e902fb8541d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:48.130054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec255b33-0fbe-4d60-8374-2e902fb8541d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.130481 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ec255b33-0fbe-4d60-8374-2e902fb8541d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:48.191313 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ec255b33-0fbe-4d60-8374-2e902fb8541d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:48.200118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ec255b33-0fbe-4d60-8374-2e902fb8541d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.082667 Jun 23 22:45:48.202204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 48/89] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:48 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:48.509131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-759655f9-e3c5-402f-88bf-8a2cc415eb92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:48.510353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-759655f9-e3c5-402f-88bf-8a2cc415eb92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:48.516624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-759655f9-e3c5-402f-88bf-8a2cc415eb92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.517078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-759655f9-e3c5-402f-88bf-8a2cc415eb92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:48.517851 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-759655f9-e3c5-402f-88bf-8a2cc415eb92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.518308 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-759655f9-e3c5-402f-88bf-8a2cc415eb92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:48.590889 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-759655f9-e3c5-402f-88bf-8a2cc415eb92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:48.599093 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-759655f9-e3c5-402f-88bf-8a2cc415eb92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1279 microversion: 2.1 time: 0.093917 Jun 23 22:45:48.599651 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 42/90] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:48 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:48.929882 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:48.930490 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:48.937483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.937932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:48.938978 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:48.939590 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.080096 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8935580b-a939-41ef-8223-bb5d990c4b16 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:49.081031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8935580b-a939-41ef-8223-bb5d990c4b16 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:49.090566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8935580b-a939-41ef-8223-bb5d990c4b16 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:49.091283 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8935580b-a939-41ef-8223-bb5d990c4b16 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.092061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8935580b-a939-41ef-8223-bb5d990c4b16 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:49.092500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8935580b-a939-41ef-8223-bb5d990c4b16 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.096496 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:49.106588 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:49.108283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:49.109948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0f517176-a919-4d11-a40c-77aa16ef600e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.184874 Jun 23 22:45:49.120643 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 49/91] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:48 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:49.218892 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5302633f-de50-4c4d-ba63-517b0d837d33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:49.219702 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5302633f-de50-4c4d-ba63-517b0d837d33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:49.225654 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5302633f-de50-4c4d-ba63-517b0d837d33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:49.226221 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5302633f-de50-4c4d-ba63-517b0d837d33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.227510 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5302633f-de50-4c4d-ba63-517b0d837d33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:49.227510 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5302633f-de50-4c4d-ba63-517b0d837d33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.254807 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8935580b-a939-41ef-8223-bb5d990c4b16 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:49.263859 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8935580b-a939-41ef-8223-bb5d990c4b16 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.187784 Jun 23 22:45:49.264429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 43/92] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:49 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:49.317155 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5302633f-de50-4c4d-ba63-517b0d837d33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:49.326212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5302633f-de50-4c4d-ba63-517b0d837d33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.111961 Jun 23 22:45:49.326893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 50/93] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:49 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:49.614987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-eb6b0ca9-79f5-4d6e-a522-6c6bf2427e5e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:49.615589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-eb6b0ca9-79f5-4d6e-a522-6c6bf2427e5e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:49.622599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eb6b0ca9-79f5-4d6e-a522-6c6bf2427e5e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:49.623039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eb6b0ca9-79f5-4d6e-a522-6c6bf2427e5e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.623784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eb6b0ca9-79f5-4d6e-a522-6c6bf2427e5e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:49.624215 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eb6b0ca9-79f5-4d6e-a522-6c6bf2427e5e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:49.684765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-eb6b0ca9-79f5-4d6e-a522-6c6bf2427e5e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:49.692359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-eb6b0ca9-79f5-4d6e-a522-6c6bf2427e5e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1279 microversion: 2.1 time: 0.081105 Jun 23 22:45:49.692962 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 44/94] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:49 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1279 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:50.129486 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:50.130012 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:50.136290 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.136773 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.137578 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.138011 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.279488 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:50.281409 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0fc9f7ff-59a9-4663-b203-906a1b486811 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:50.282213 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0fc9f7ff-59a9-4663-b203-906a1b486811 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:50.295933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:50.297551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:50.297873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0fc9f7ff-59a9-4663-b203-906a1b486811 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.298324 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0fc9f7ff-59a9-4663-b203-906a1b486811 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.298672 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a9d2ff0f-7028-4305-8801-6725f4d9c021 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.173291 Jun 23 22:45:50.299111 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0fc9f7ff-59a9-4663-b203-906a1b486811 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.299210 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 51/95] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:50 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:50.299629 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0fc9f7ff-59a9-4663-b203-906a1b486811 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.349548 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a8a61cb4-0532-4e34-9af2-e4db78c13d8b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:50.350334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a8a61cb4-0532-4e34-9af2-e4db78c13d8b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:50.357337 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8a61cb4-0532-4e34-9af2-e4db78c13d8b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.358410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8a61cb4-0532-4e34-9af2-e4db78c13d8b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.359072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8a61cb4-0532-4e34-9af2-e4db78c13d8b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.359660 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8a61cb4-0532-4e34-9af2-e4db78c13d8b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.424811 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a8a61cb4-0532-4e34-9af2-e4db78c13d8b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:50.441759 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0fc9f7ff-59a9-4663-b203-906a1b486811 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:50.443497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a8a61cb4-0532-4e34-9af2-e4db78c13d8b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.102413 Jun 23 22:45:50.444112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 52/96] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:50 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:50.457329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0fc9f7ff-59a9-4663-b203-906a1b486811 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.179547 Jun 23 22:45:50.458293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 45/97] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:50 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:50.718376 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4f9bfd8e-73a7-4b7e-96cd-7ede033bfd66 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:50.718960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4f9bfd8e-73a7-4b7e-96cd-7ede033bfd66 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:50.725472 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4f9bfd8e-73a7-4b7e-96cd-7ede033bfd66 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.731958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4f9bfd8e-73a7-4b7e-96cd-7ede033bfd66 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.733003 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4f9bfd8e-73a7-4b7e-96cd-7ede033bfd66 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:50.733463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4f9bfd8e-73a7-4b7e-96cd-7ede033bfd66 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:50.825385 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4f9bfd8e-73a7-4b7e-96cd-7ede033bfd66 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:50.833235 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4f9bfd8e-73a7-4b7e-96cd-7ede033bfd66 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1279 microversion: 2.1 time: 0.118733 Jun 23 22:45:50.833930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 53/98] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:50 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1279 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:51.317632 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:51.319862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:51.327406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:51.327850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:51.328663 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:51.329094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:51.466242 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7641cd5f-d342-41d8-8731-642344fd255e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:51.467560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7641cd5f-d342-41d8-8731-642344fd255e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:51.475817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7641cd5f-d342-41d8-8731-642344fd255e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:51.476923 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7641cd5f-d342-41d8-8731-642344fd255e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:51.477872 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7641cd5f-d342-41d8-8731-642344fd255e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:51.479925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7641cd5f-d342-41d8-8731-642344fd255e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:51.482411 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:51.493190 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:51.498330 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:51.498330 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2ee351fb-f32f-459b-8674-c42fe4f22e0e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.183451 Jun 23 22:45:51.510484 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 46/99] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:51 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:51.518207 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5a3eea00-b7b4-452d-8952-d0dffb970ff5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:51.518207 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5a3eea00-b7b4-452d-8952-d0dffb970ff5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:51.523491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5a3eea00-b7b4-452d-8952-d0dffb970ff5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:51.523942 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5a3eea00-b7b4-452d-8952-d0dffb970ff5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:51.524758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5a3eea00-b7b4-452d-8952-d0dffb970ff5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:51.525722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5a3eea00-b7b4-452d-8952-d0dffb970ff5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:51.552763 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7641cd5f-d342-41d8-8731-642344fd255e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:51.561713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7641cd5f-d342-41d8-8731-642344fd255e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1292 microversion: 2.1 time: 0.100175 Jun 23 22:45:51.562287 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 54/100] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:51 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:51.690081 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5a3eea00-b7b4-452d-8952-d0dffb970ff5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:51.706440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5a3eea00-b7b4-452d-8952-d0dffb970ff5 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.186054 Jun 23 22:45:51.706440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 47/101] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:51 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:51.851828 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6ede81e4-5cde-4c56-8fa4-9358b41f1e70 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:51.852717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6ede81e4-5cde-4c56-8fa4-9358b41f1e70 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:51.862275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ede81e4-5cde-4c56-8fa4-9358b41f1e70 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:51.879437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ede81e4-5cde-4c56-8fa4-9358b41f1e70 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:51.879437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ede81e4-5cde-4c56-8fa4-9358b41f1e70 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:51.879437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6ede81e4-5cde-4c56-8fa4-9358b41f1e70 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.015588 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6ede81e4-5cde-4c56-8fa4-9358b41f1e70 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:52.025959 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6ede81e4-5cde-4c56-8fa4-9358b41f1e70 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1279 microversion: 2.1 time: 0.177841 Jun 23 22:45:52.027014 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 55/102] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:51 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:52.516291 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:52.517722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:52.524656 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:52.525720 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.526678 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:52.527328 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.550767 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:52.580289 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f6a95a40-668e-4eec-a8f7-3ba96964c7cf tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:52.581045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f6a95a40-668e-4eec-a8f7-3ba96964c7cf tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:52.588403 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6a95a40-668e-4eec-a8f7-3ba96964c7cf tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:52.592457 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6a95a40-668e-4eec-a8f7-3ba96964c7cf tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.592457 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6a95a40-668e-4eec-a8f7-3ba96964c7cf tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:52.592457 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6a95a40-668e-4eec-a8f7-3ba96964c7cf tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.716935 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f6a95a40-668e-4eec-a8f7-3ba96964c7cf tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:52.734778 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f6a95a40-668e-4eec-a8f7-3ba96964c7cf tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1300 microversion: 2.1 time: 0.158771 Jun 23 22:45:52.736309 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 56/103] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:52 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:52.753955 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e6a23d83-2821-438b-a6d3-eed9f6968d67 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:52.754701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e6a23d83-2821-438b-a6d3-eed9f6968d67 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:52.765965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6a23d83-2821-438b-a6d3-eed9f6968d67 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:52.766655 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6a23d83-2821-438b-a6d3-eed9f6968d67 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.767660 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6a23d83-2821-438b-a6d3-eed9f6968d67 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:52.768230 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6a23d83-2821-438b-a6d3-eed9f6968d67 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:52.861925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:52.873167 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:52.874256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:52.876064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a5a6a48b-d0fb-42bc-a57f-925752f86c64 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.363688 Jun 23 22:45:52.876884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 48/104] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:52 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:53.044307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-40d0609b-0258-4aae-b0b7-a11eb98feee0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:53.045245 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-40d0609b-0258-4aae-b0b7-a11eb98feee0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:53.051542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-40d0609b-0258-4aae-b0b7-a11eb98feee0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:53.056761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-40d0609b-0258-4aae-b0b7-a11eb98feee0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:53.056761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-40d0609b-0258-4aae-b0b7-a11eb98feee0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:53.056761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-40d0609b-0258-4aae-b0b7-a11eb98feee0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:53.392462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e6a23d83-2821-438b-a6d3-eed9f6968d67 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:53.407586 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e6a23d83-2821-438b-a6d3-eed9f6968d67 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.669399 Jun 23 22:45:53.410615 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 57/105] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:52 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:53.514506 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-40d0609b-0258-4aae-b0b7-a11eb98feee0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:53.522462 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-40d0609b-0258-4aae-b0b7-a11eb98feee0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.482873 Jun 23 22:45:53.531400 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 49/106] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:53 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:53.755623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e91ac739-6257-4ae8-97c4-a64f1f12a51d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:53.757272 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e91ac739-6257-4ae8-97c4-a64f1f12a51d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:53.765654 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e91ac739-6257-4ae8-97c4-a64f1f12a51d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:53.766243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e91ac739-6257-4ae8-97c4-a64f1f12a51d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:53.767185 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e91ac739-6257-4ae8-97c4-a64f1f12a51d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:53.767716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e91ac739-6257-4ae8-97c4-a64f1f12a51d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:53.898338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:53.899198 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:53.912137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:53.912821 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:53.914959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:53.918082 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:54.078864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e91ac739-6257-4ae8-97c4-a64f1f12a51d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:54.092841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e91ac739-6257-4ae8-97c4-a64f1f12a51d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1298 microversion: 2.1 time: 0.343929 Jun 23 22:45:54.093589 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 58/107] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:53 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1298 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:54.432443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e7d12a02-58fd-4fc7-b6ad-9f919e2334dc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:54.433284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e7d12a02-58fd-4fc7-b6ad-9f919e2334dc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:54.450454 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7d12a02-58fd-4fc7-b6ad-9f919e2334dc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:54.451173 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7d12a02-58fd-4fc7-b6ad-9f919e2334dc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:54.452306 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7d12a02-58fd-4fc7-b6ad-9f919e2334dc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:54.453511 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e7d12a02-58fd-4fc7-b6ad-9f919e2334dc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:54.584988 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:54.589571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:54.592829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:54.594031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1c794fe6-fc77-4a11-a8f0-57f21a6bae90 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.702088 Jun 23 22:45:54.594600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 50/108] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:53 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:54.610490 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ba176e5c-a163-4c7a-879a-ddc82be1c3eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:54.613551 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ba176e5c-a163-4c7a-879a-ddc82be1c3eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:54.622360 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba176e5c-a163-4c7a-879a-ddc82be1c3eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:54.622804 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba176e5c-a163-4c7a-879a-ddc82be1c3eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:54.623572 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba176e5c-a163-4c7a-879a-ddc82be1c3eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:54.623999 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba176e5c-a163-4c7a-879a-ddc82be1c3eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:54.898270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e7d12a02-58fd-4fc7-b6ad-9f919e2334dc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:54.915369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e7d12a02-58fd-4fc7-b6ad-9f919e2334dc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.489507 Jun 23 22:45:54.916597 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 59/109] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:54 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:55.060806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ba176e5c-a163-4c7a-879a-ddc82be1c3eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:55.064204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-553003a1-d826-44a8-9a20-fcc4e9743b00 req-5aef0273-dae8-4d7a-a830-cfa1fb042244 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "973339fb-cfbd-4b97-97cd-db9e6e1464f3", "tag": "676858b6-7682-4a1b-a92a-78faad862938"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:55.075420 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ba176e5c-a163-4c7a-879a-ddc82be1c3eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.478060 Jun 23 22:45:55.076476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 51/110] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:54 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:55.095617 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-553003a1-d826-44a8-9a20-fcc4e9743b00 req-5aef0273-dae8-4d7a-a830-cfa1fb042244 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.096198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-553003a1-d826-44a8-9a20-fcc4e9743b00 req-5aef0273-dae8-4d7a-a830-cfa1fb042244 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.109112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:45:55.110873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-288e25d8-c475-47ab-9c5e-1eb5ce083c89 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:55.111672 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-288e25d8-c475-47ab-9c5e-1eb5ce083c89 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:55.119755 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-553003a1-d826-44a8-9a20-fcc4e9743b00 req-5aef0273-dae8-4d7a-a830-cfa1fb042244 service nova] Creating event network-changed:676858b6-7682-4a1b-a92a-78faad862938 for instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 on hv-cinder-81322 Jun 23 22:45:55.119755 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-553003a1-d826-44a8-9a20-fcc4e9743b00 req-5aef0273-dae8-4d7a-a830-cfa1fb042244 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 22:45:55.129096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c60167d9-7ce0-4edf-8a69-82b2e207de2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.129096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c60167d9-7ce0-4edf-8a69-82b2e207de2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.129096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c60167d9-7ce0-4edf-8a69-82b2e207de2b None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.129096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c60167d9-7ce0-4edf-8a69-82b2e207de2b None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.139726 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-288e25d8-c475-47ab-9c5e-1eb5ce083c89 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.143416 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-288e25d8-c475-47ab-9c5e-1eb5ce083c89 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.143809 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.compute.rpcapi [None req-c60167d9-7ce0-4edf-8a69-82b2e207de2b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 22:45:55.144474 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-288e25d8-c475-47ab-9c5e-1eb5ce083c89 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.144948 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-288e25d8-c475-47ab-9c5e-1eb5ce083c89 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.147026 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c60167d9-7ce0-4edf-8a69-82b2e207de2b None None] Releasing lock "compute-rpcapi-router" {{(pid=124725) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 22:45:55.171945 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c60167d9-7ce0-4edf-8a69-82b2e207de2b None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210509 Jun 23 22:45:55.175018 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 60/111] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:55.313685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-288e25d8-c475-47ab-9c5e-1eb5ce083c89 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:55.326178 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-288e25d8-c475-47ab-9c5e-1eb5ce083c89 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1298 microversion: 2.1 time: 0.219037 Jun 23 22:45:55.327583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 52/112] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:55 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1298 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:55.613825 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:55.614456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:55.623603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.624059 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.625729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.625812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.646869 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-28fcd82d-a556-4d90-bd9f-231c3f65a68f req-28eda1f2-bd74-4bdb-adde-0b9e80aa24b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192d5777-a83f-473b-bc1d-6ae78bd7326c", "tag": "f65b1997-349a-4f3b-8290-efaec03c5e9e"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:55.657370 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-28fcd82d-a556-4d90-bd9f-231c3f65a68f req-28eda1f2-bd74-4bdb-adde-0b9e80aa24b3 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.658047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-28fcd82d-a556-4d90-bd9f-231c3f65a68f req-28eda1f2-bd74-4bdb-adde-0b9e80aa24b3 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.680559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-28fcd82d-a556-4d90-bd9f-231c3f65a68f req-28eda1f2-bd74-4bdb-adde-0b9e80aa24b3 service nova] Creating event network-changed:f65b1997-349a-4f3b-8290-efaec03c5e9e for instance 192d5777-a83f-473b-bc1d-6ae78bd7326c on hv-cinder-81322 Jun 23 22:45:55.689678 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-28fcd82d-a556-4d90-bd9f-231c3f65a68f req-28eda1f2-bd74-4bdb-adde-0b9e80aa24b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129842 Jun 23 22:45:55.692629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 61/113] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:55.933736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a32f5816-cc3c-4900-901c-7cdee6a76154 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:55.934434 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a32f5816-cc3c-4900-901c-7cdee6a76154 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:55.941174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f5816-cc3c-4900-901c-7cdee6a76154 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.941543 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f5816-cc3c-4900-901c-7cdee6a76154 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.942504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f5816-cc3c-4900-901c-7cdee6a76154 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:55.942993 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a32f5816-cc3c-4900-901c-7cdee6a76154 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:55.968084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:55.990633 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:55.994391 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:55.998296 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-bcceb675-f82c-43c5-b16c-3cb301ba9d32 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.388476 Jun 23 22:45:56.010293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 53/114] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:55 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:56.092983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c1ca1269-0a09-41a8-9672-e0d7f2cd2567 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:56.094127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c1ca1269-0a09-41a8-9672-e0d7f2cd2567 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:56.101272 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a32f5816-cc3c-4900-901c-7cdee6a76154 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:56.107519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c1ca1269-0a09-41a8-9672-e0d7f2cd2567 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:56.108473 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c1ca1269-0a09-41a8-9672-e0d7f2cd2567 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:56.112328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a32f5816-cc3c-4900-901c-7cdee6a76154 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.181558 Jun 23 22:45:56.113432 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 62/115] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:55 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:45:56.116937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c1ca1269-0a09-41a8-9672-e0d7f2cd2567 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:56.117378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c1ca1269-0a09-41a8-9672-e0d7f2cd2567 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:56.293406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c1ca1269-0a09-41a8-9672-e0d7f2cd2567 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:56.302055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c1ca1269-0a09-41a8-9672-e0d7f2cd2567 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.213287 Jun 23 22:45:56.311913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 54/116] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:56 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:56.344472 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c6a93e18-3325-4dd1-b69b-206e70b5da3d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:56.351180 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c6a93e18-3325-4dd1-b69b-206e70b5da3d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:56.352149 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6a93e18-3325-4dd1-b69b-206e70b5da3d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:56.352662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6a93e18-3325-4dd1-b69b-206e70b5da3d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:56.354603 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6a93e18-3325-4dd1-b69b-206e70b5da3d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:56.354976 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6a93e18-3325-4dd1-b69b-206e70b5da3d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:56.498287 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c6a93e18-3325-4dd1-b69b-206e70b5da3d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:56.505825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c6a93e18-3325-4dd1-b69b-206e70b5da3d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.165727 Jun 23 22:45:56.506570 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 63/117] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:56 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:57.023710 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:57.023710 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:57.043907 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.046734 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.048151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.052233 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.131423 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b6d63a45-6c55-4890-891f-6b83eee6c813 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:57.132031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b6d63a45-6c55-4890-891f-6b83eee6c813 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:57.143514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6d63a45-6c55-4890-891f-6b83eee6c813 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.144208 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6d63a45-6c55-4890-891f-6b83eee6c813 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.145252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6d63a45-6c55-4890-891f-6b83eee6c813 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.146633 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6d63a45-6c55-4890-891f-6b83eee6c813 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.467379 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:57.481793 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:57.486124 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:57.490709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-08039749-0890-46a7-b683-495d51362591 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.476815 Jun 23 22:45:57.493459 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 55/118] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:57 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:45:57.513075 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-42bb2e95-6826-4745-869c-72d0841c89ab req-eda4d87b-094d-4fa2-8fe0-997f8b5292a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7185d851-3beb-40db-9d52-d401b0db2367", "tag": "ef90cb7d-19ed-4cbb-8b5b-b499ea919109"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:57.539685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-42bb2e95-6826-4745-869c-72d0841c89ab req-eda4d87b-094d-4fa2-8fe0-997f8b5292a8 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.540989 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-42bb2e95-6826-4745-869c-72d0841c89ab req-eda4d87b-094d-4fa2-8fe0-997f8b5292a8 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.589238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-42bb2e95-6826-4745-869c-72d0841c89ab req-eda4d87b-094d-4fa2-8fe0-997f8b5292a8 service nova] Creating event network-changed:ef90cb7d-19ed-4cbb-8b5b-b499ea919109 for instance 7185d851-3beb-40db-9d52-d401b0db2367 on hv-cinder-81322 Jun 23 22:45:57.590196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-42bb2e95-6826-4745-869c-72d0841c89ab req-eda4d87b-094d-4fa2-8fe0-997f8b5292a8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 22:45:57.593158 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2090a589-b8bc-4786-8ff8-13c7324543ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.594229 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2090a589-b8bc-4786-8ff8-13c7324543ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.597173 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2090a589-b8bc-4786-8ff8-13c7324543ac None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.597616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2090a589-b8bc-4786-8ff8-13c7324543ac None None] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.620696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.compute.rpcapi [None req-2090a589-b8bc-4786-8ff8-13c7324543ac None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 22:45:57.626891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2090a589-b8bc-4786-8ff8-13c7324543ac None None] Releasing lock "compute-rpcapi-router" {{(pid=124724) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 22:45:57.660322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2090a589-b8bc-4786-8ff8-13c7324543ac None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159484 Jun 23 22:45:57.663442 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 56/119] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:57.670071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b569b0b1-ad8c-4676-b29c-910692355f25 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:57.671165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b569b0b1-ad8c-4676-b29c-910692355f25 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:57.680790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b569b0b1-ad8c-4676-b29c-910692355f25 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.680790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b569b0b1-ad8c-4676-b29c-910692355f25 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:57.680790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b569b0b1-ad8c-4676-b29c-910692355f25 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:57.680790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b569b0b1-ad8c-4676-b29c-910692355f25 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.011371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b6d63a45-6c55-4890-891f-6b83eee6c813 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:58.020077 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b6d63a45-6c55-4890-891f-6b83eee6c813 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.892129 Jun 23 22:45:58.031727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 64/120] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:57 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:58.041237 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d52c04bd-9ee9-4374-8ab3-7b45c3147d49 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:58.042028 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d52c04bd-9ee9-4374-8ab3-7b45c3147d49 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:58.065916 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d52c04bd-9ee9-4374-8ab3-7b45c3147d49 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.067052 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d52c04bd-9ee9-4374-8ab3-7b45c3147d49 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.067867 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d52c04bd-9ee9-4374-8ab3-7b45c3147d49 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.068299 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d52c04bd-9ee9-4374-8ab3-7b45c3147d49 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.329625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b569b0b1-ad8c-4676-b29c-910692355f25 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:58.342714 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b569b0b1-ad8c-4676-b29c-910692355f25 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.677603 Jun 23 22:45:58.345510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 57/121] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:57 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:58.361717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-e1255789-b093-4caf-b318-78412b5f2cea req-b2e20ee3-c196-43e0-886a-2df8c027c402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "286fefab-3729-4c09-a3be-0af864c6de65", "tag": "b2734dfe-80ab-464a-85a5-81204d7db18e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:45:58.375987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-e1255789-b093-4caf-b318-78412b5f2cea req-b2e20ee3-c196-43e0-886a-2df8c027c402 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.379836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-e1255789-b093-4caf-b318-78412b5f2cea req-b2e20ee3-c196-43e0-886a-2df8c027c402 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.407364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-e1255789-b093-4caf-b318-78412b5f2cea req-b2e20ee3-c196-43e0-886a-2df8c027c402 service nova] Creating event network-changed:b2734dfe-80ab-464a-85a5-81204d7db18e for instance 286fefab-3729-4c09-a3be-0af864c6de65 on hv-cinder-81322 Jun 23 22:45:58.412830 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-e1255789-b093-4caf-b318-78412b5f2cea req-b2e20ee3-c196-43e0-886a-2df8c027c402 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065059 Jun 23 22:45:58.414086 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 58/122] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:45:58.512732 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:58.513359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:58.531123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.531123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.531123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:58.531123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:58.753535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d52c04bd-9ee9-4374-8ab3-7b45c3147d49 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:58.763679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d52c04bd-9ee9-4374-8ab3-7b45c3147d49 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.730337 Jun 23 22:45:58.766301 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 65/123] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:58 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:58.807820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:58.816124 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:58.817956 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:58.819298 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b2708314-3651-41c9-9438-8fd711799344 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.311772 Jun 23 22:45:58.831036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 59/124] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:58 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:45:59.038355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1748624c-93c4-45e6-b586-1085fa85a9a0 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:59.042025 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1748624c-93c4-45e6-b586-1085fa85a9a0 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:59.045902 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1748624c-93c4-45e6-b586-1085fa85a9a0 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:59.050410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1748624c-93c4-45e6-b586-1085fa85a9a0 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:59.051629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1748624c-93c4-45e6-b586-1085fa85a9a0 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:59.052601 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1748624c-93c4-45e6-b586-1085fa85a9a0 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:59.259773 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1748624c-93c4-45e6-b586-1085fa85a9a0 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:59.267418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1748624c-93c4-45e6-b586-1085fa85a9a0 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.233097 Jun 23 22:45:59.267918 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 66/125] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:59 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:59.365243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5662c6a9-c2c8-4d7e-b70b-c747f342c14b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:59.365867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5662c6a9-c2c8-4d7e-b70b-c747f342c14b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:59.374447 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5662c6a9-c2c8-4d7e-b70b-c747f342c14b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:59.374897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5662c6a9-c2c8-4d7e-b70b-c747f342c14b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:59.375708 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5662c6a9-c2c8-4d7e-b70b-c747f342c14b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:59.376073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5662c6a9-c2c8-4d7e-b70b-c747f342c14b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:59.591603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5662c6a9-c2c8-4d7e-b70b-c747f342c14b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:45:59.599502 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5662c6a9-c2c8-4d7e-b70b-c747f342c14b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.238762 Jun 23 22:45:59.609348 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 60/126] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:59 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:45:59.787382 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-72badeab-f46a-4361-8c35-755201c776e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:59.788602 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-72badeab-f46a-4361-8c35-755201c776e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:59.795468 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-72badeab-f46a-4361-8c35-755201c776e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:59.796157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-72badeab-f46a-4361-8c35-755201c776e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:59.797087 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-72badeab-f46a-4361-8c35-755201c776e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:59.797658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-72badeab-f46a-4361-8c35-755201c776e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:59.836907 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:45:59.837535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:45:59.843709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:59.844150 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:45:59.844931 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:45:59.845359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:00.055137 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-72badeab-f46a-4361-8c35-755201c776e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:00.064228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-72badeab-f46a-4361-8c35-755201c776e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.282183 Jun 23 22:46:00.065645 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 67/127] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:45:59 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:00.078706 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:00.098568 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:00.100080 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:00.101206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-99547c6f-71c6-4b70-85a2-e6e291eed684 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.268045 Jun 23 22:46:00.101760 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 61/128] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:45:59 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:00.294587 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c50c66c5-0944-478c-a2dd-0eb4b2cb41fc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:00.295931 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c50c66c5-0944-478c-a2dd-0eb4b2cb41fc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:00.303127 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c50c66c5-0944-478c-a2dd-0eb4b2cb41fc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:00.303584 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c50c66c5-0944-478c-a2dd-0eb4b2cb41fc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:00.305366 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c50c66c5-0944-478c-a2dd-0eb4b2cb41fc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:00.305366 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c50c66c5-0944-478c-a2dd-0eb4b2cb41fc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:00.487990 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-812dd514-b34f-4c5e-84c5-f6c0892cea13 req-9466577b-3c0f-47ca-a36e-74fd1a16bc59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8042229-5eb7-4d72-a37f-d3d15dff51b8", "tag": "82d58367-4f7b-41b7-82c3-2460e09a1f13"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:00.496199 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-812dd514-b34f-4c5e-84c5-f6c0892cea13 req-9466577b-3c0f-47ca-a36e-74fd1a16bc59 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:00.496750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-812dd514-b34f-4c5e-84c5-f6c0892cea13 req-9466577b-3c0f-47ca-a36e-74fd1a16bc59 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:00.512013 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-812dd514-b34f-4c5e-84c5-f6c0892cea13 req-9466577b-3c0f-47ca-a36e-74fd1a16bc59 service nova] Creating event network-changed:82d58367-4f7b-41b7-82c3-2460e09a1f13 for instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 on hv-cinder-81322 Jun 23 22:46:00.518216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-812dd514-b34f-4c5e-84c5-f6c0892cea13 req-9466577b-3c0f-47ca-a36e-74fd1a16bc59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034961 Jun 23 22:46:00.520207 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 62/129] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:00.616928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c50c66c5-0944-478c-a2dd-0eb4b2cb41fc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:00.619194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0556400a-d589-4ffe-a134-d963bce192e4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:00.619909 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0556400a-d589-4ffe-a134-d963bce192e4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:00.627664 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0556400a-d589-4ffe-a134-d963bce192e4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:00.628107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0556400a-d589-4ffe-a134-d963bce192e4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:00.629006 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c50c66c5-0944-478c-a2dd-0eb4b2cb41fc tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.347489 Jun 23 22:46:00.630215 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0556400a-d589-4ffe-a134-d963bce192e4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:00.630705 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0556400a-d589-4ffe-a134-d963bce192e4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:00.633199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 68/130] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:00 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:00.767886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0556400a-d589-4ffe-a134-d963bce192e4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:00.776055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0556400a-d589-4ffe-a134-d963bce192e4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.162433 Jun 23 22:46:00.776635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 63/131] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:00 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:01.082582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-167d30cc-60db-428e-8b4a-173bdb111f14 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:01.083095 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-167d30cc-60db-428e-8b4a-173bdb111f14 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:01.089448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-167d30cc-60db-428e-8b4a-173bdb111f14 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:01.089884 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-167d30cc-60db-428e-8b4a-173bdb111f14 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:01.090631 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-167d30cc-60db-428e-8b4a-173bdb111f14 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:01.091054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-167d30cc-60db-428e-8b4a-173bdb111f14 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:01.120330 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:01.120984 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:01.127322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:01.127771 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:01.128535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:01.128993 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:01.221183 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-167d30cc-60db-428e-8b4a-173bdb111f14 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:01.229634 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-167d30cc-60db-428e-8b4a-173bdb111f14 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.150943 Jun 23 22:46:01.230202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 69/132] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:01 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:01.257543 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:01.265405 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:01.266923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:01.268016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-31063150-6462-452e-95ae-6369a32ecd9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.152515 Jun 23 22:46:01.268597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 64/133] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:01 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:01.649127 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6351e536-59ce-458f-89e3-4d54c54dfe0d tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:01.649699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6351e536-59ce-458f-89e3-4d54c54dfe0d tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:01.655689 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6351e536-59ce-458f-89e3-4d54c54dfe0d tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:01.656234 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6351e536-59ce-458f-89e3-4d54c54dfe0d tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:01.657616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6351e536-59ce-458f-89e3-4d54c54dfe0d tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:01.657616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6351e536-59ce-458f-89e3-4d54c54dfe0d tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:01.781743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6351e536-59ce-458f-89e3-4d54c54dfe0d tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:01.789369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6351e536-59ce-458f-89e3-4d54c54dfe0d tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.144183 Jun 23 22:46:01.789929 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 70/134] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:01 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:01.793396 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-72917d15-e131-4701-aef1-3f0cc4de8136 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:01.794004 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-72917d15-e131-4701-aef1-3f0cc4de8136 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:01.799987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72917d15-e131-4701-aef1-3f0cc4de8136 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:01.800423 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72917d15-e131-4701-aef1-3f0cc4de8136 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:01.801211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72917d15-e131-4701-aef1-3f0cc4de8136 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:01.801641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72917d15-e131-4701-aef1-3f0cc4de8136 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:01.937403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-72917d15-e131-4701-aef1-3f0cc4de8136 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:01.944806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-72917d15-e131-4701-aef1-3f0cc4de8136 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.155729 Jun 23 22:46:01.945350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 65/135] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:01 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:02.246517 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8a6642d9-b132-44f8-b4b3-325801ce16c7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:02.247393 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8a6642d9-b132-44f8-b4b3-325801ce16c7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:02.253376 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a6642d9-b132-44f8-b4b3-325801ce16c7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.253813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a6642d9-b132-44f8-b4b3-325801ce16c7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.254581 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a6642d9-b132-44f8-b4b3-325801ce16c7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.255004 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a6642d9-b132-44f8-b4b3-325801ce16c7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.286280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:02.287016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:02.293342 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.293790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.294553 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.294983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.386462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8a6642d9-b132-44f8-b4b3-325801ce16c7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:02.393832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8a6642d9-b132-44f8-b4b3-325801ce16c7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.151675 Jun 23 22:46:02.394480 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 71/136] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:02 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:02.423975 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:02.427475 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:02.433425 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:02.434969 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:02.436086 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c7edd681-eed1-456f-bcfb-9c9193092a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.153649 Jun 23 22:46:02.436662 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 66/137] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:02 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:02.806570 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-971a5b0c-14ea-496c-8621-4dd2d1d16b72 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:02.807099 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-971a5b0c-14ea-496c-8621-4dd2d1d16b72 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:02.813074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-971a5b0c-14ea-496c-8621-4dd2d1d16b72 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.813516 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-971a5b0c-14ea-496c-8621-4dd2d1d16b72 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.814272 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-971a5b0c-14ea-496c-8621-4dd2d1d16b72 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.814704 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-971a5b0c-14ea-496c-8621-4dd2d1d16b72 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.938411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-971a5b0c-14ea-496c-8621-4dd2d1d16b72 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:02.945824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-971a5b0c-14ea-496c-8621-4dd2d1d16b72 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.143177 Jun 23 22:46:02.946395 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 72/138] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:02 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:02.961388 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-448d097e-e177-406f-8a63-24e1597340db tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:02.962068 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-448d097e-e177-406f-8a63-24e1597340db tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:02.968861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-448d097e-e177-406f-8a63-24e1597340db tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.969304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-448d097e-e177-406f-8a63-24e1597340db tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:02.970057 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-448d097e-e177-406f-8a63-24e1597340db tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:02.970488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-448d097e-e177-406f-8a63-24e1597340db tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:03.099577 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-448d097e-e177-406f-8a63-24e1597340db tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:03.107647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-448d097e-e177-406f-8a63-24e1597340db tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.150115 Jun 23 22:46:03.108216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 67/139] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:02 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:03.410969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9e368b20-3088-4677-9803-8d4cf9154606 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:03.411495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9e368b20-3088-4677-9803-8d4cf9154606 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:03.417998 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e368b20-3088-4677-9803-8d4cf9154606 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:03.418444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e368b20-3088-4677-9803-8d4cf9154606 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:03.419192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e368b20-3088-4677-9803-8d4cf9154606 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:03.419623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9e368b20-3088-4677-9803-8d4cf9154606 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:03.454449 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:03.455052 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:03.461307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:03.461756 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:03.463094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:03.463524 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:03.551528 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9e368b20-3088-4677-9803-8d4cf9154606 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:03.559720 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9e368b20-3088-4677-9803-8d4cf9154606 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.152591 Jun 23 22:46:03.560316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 73/140] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:03 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:03.593369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:03.601444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:03.603604 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:03.605103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-63fdb25b-f742-41dc-a57c-5149300e3ef5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.154479 Jun 23 22:46:03.615221 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 68/141] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:03 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:03.962911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f6a5e89c-0915-4746-820b-9041bee5fb7a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:03.963513 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f6a5e89c-0915-4746-820b-9041bee5fb7a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:03.969550 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6a5e89c-0915-4746-820b-9041bee5fb7a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:03.969986 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6a5e89c-0915-4746-820b-9041bee5fb7a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:03.970733 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6a5e89c-0915-4746-820b-9041bee5fb7a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:03.971197 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f6a5e89c-0915-4746-820b-9041bee5fb7a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.125912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fc70df1f-2ea6-4d3c-92da-313d39c2d078 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:04.126518 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fc70df1f-2ea6-4d3c-92da-313d39c2d078 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:04.138721 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc70df1f-2ea6-4d3c-92da-313d39c2d078 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:04.139174 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc70df1f-2ea6-4d3c-92da-313d39c2d078 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.139950 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc70df1f-2ea6-4d3c-92da-313d39c2d078 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:04.140383 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc70df1f-2ea6-4d3c-92da-313d39c2d078 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.293539 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f6a5e89c-0915-4746-820b-9041bee5fb7a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.303418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f6a5e89c-0915-4746-820b-9041bee5fb7a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.344607 Jun 23 22:46:04.313876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 74/142] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:03 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:04.327400 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-fc70df1f-2ea6-4d3c-92da-313d39c2d078 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.333729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fc70df1f-2ea6-4d3c-92da-313d39c2d078 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.212275 Jun 23 22:46:04.334290 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 69/143] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:04 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:04.577422 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-86eaa6b9-df39-43d6-961c-5ddeb6cf43be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:04.578024 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86eaa6b9-df39-43d6-961c-5ddeb6cf43be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:04.584092 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86eaa6b9-df39-43d6-961c-5ddeb6cf43be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:04.584536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86eaa6b9-df39-43d6-961c-5ddeb6cf43be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.585317 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86eaa6b9-df39-43d6-961c-5ddeb6cf43be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:04.585753 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86eaa6b9-df39-43d6-961c-5ddeb6cf43be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.623136 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:04.623765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:04.629895 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:04.630336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.631092 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:04.631710 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:04.733476 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-86eaa6b9-df39-43d6-961c-5ddeb6cf43be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.742843 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-86eaa6b9-df39-43d6-961c-5ddeb6cf43be tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.169200 Jun 23 22:46:04.744296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 75/144] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:04 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:04.792473 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.800721 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.802354 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:04.803455 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a9cfd0f0-034e-456b-84c9-af443e05e6a9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.185242 Jun 23 22:46:04.804353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 70/145] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:04 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:05.321176 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-58ebd28f-46f9-4294-9638-5bed76c3280a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:05.322334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-58ebd28f-46f9-4294-9638-5bed76c3280a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:05.324268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:05.329112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58ebd28f-46f9-4294-9638-5bed76c3280a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.329557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58ebd28f-46f9-4294-9638-5bed76c3280a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.330298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58ebd28f-46f9-4294-9638-5bed76c3280a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.330721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58ebd28f-46f9-4294-9638-5bed76c3280a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.350185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-53fa005f-3442-460c-b120-35b7232fadf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:05.350784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-53fa005f-3442-460c-b120-35b7232fadf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:05.356864 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-53fa005f-3442-460c-b120-35b7232fadf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.357309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-53fa005f-3442-460c-b120-35b7232fadf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.358079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-53fa005f-3442-460c-b120-35b7232fadf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.358498 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-53fa005f-3442-460c-b120-35b7232fadf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.470974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-58ebd28f-46f9-4294-9638-5bed76c3280a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.480447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-58ebd28f-46f9-4294-9638-5bed76c3280a tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.163001 Jun 23 22:46:05.485531 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 76/146] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:05 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:05.500331 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-53fa005f-3442-460c-b120-35b7232fadf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.507706 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-53fa005f-3442-460c-b120-35b7232fadf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.161317 Jun 23 22:46:05.517553 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 71/147] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:05 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:05.761432 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ed2cbba9-897a-4cb5-b3fa-652f886ac23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:05.762031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ed2cbba9-897a-4cb5-b3fa-652f886ac23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:05.768118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed2cbba9-897a-4cb5-b3fa-652f886ac23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.768557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed2cbba9-897a-4cb5-b3fa-652f886ac23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.769328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed2cbba9-897a-4cb5-b3fa-652f886ac23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.769754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ed2cbba9-897a-4cb5-b3fa-652f886ac23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.822318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:05.823131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:05.829417 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.829967 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.830790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:05.831294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:05.922752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ed2cbba9-897a-4cb5-b3fa-652f886ac23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.926163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:05.931264 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ed2cbba9-897a-4cb5-b3fa-652f886ac23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.173878 Jun 23 22:46:05.931871 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 77/148] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:05 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:05.969051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.977014 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.978632 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:05.979682 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d1d2eb0a-01d7-47b4-bb67-df7638a08e0d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.161808 Jun 23 22:46:05.980247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 72/149] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:05 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:06.501061 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-078c7738-7e3d-4b3b-80ae-9760ed3accf6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:06.501683 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-078c7738-7e3d-4b3b-80ae-9760ed3accf6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:06.509184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-078c7738-7e3d-4b3b-80ae-9760ed3accf6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.509727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-078c7738-7e3d-4b3b-80ae-9760ed3accf6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.510650 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-078c7738-7e3d-4b3b-80ae-9760ed3accf6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.511299 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-078c7738-7e3d-4b3b-80ae-9760ed3accf6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.533741 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5db1c2b8-3d51-4d2b-a237-d01f185728e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:06.534354 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5db1c2b8-3d51-4d2b-a237-d01f185728e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:06.543566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5db1c2b8-3d51-4d2b-a237-d01f185728e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.544012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5db1c2b8-3d51-4d2b-a237-d01f185728e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.544817 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5db1c2b8-3d51-4d2b-a237-d01f185728e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.548294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5db1c2b8-3d51-4d2b-a237-d01f185728e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.685317 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-078c7738-7e3d-4b3b-80ae-9760ed3accf6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:06.696346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-078c7738-7e3d-4b3b-80ae-9760ed3accf6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.199791 Jun 23 22:46:06.705802 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 78/150] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:06 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:06.748486 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5db1c2b8-3d51-4d2b-a237-d01f185728e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:06.759452 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5db1c2b8-3d51-4d2b-a237-d01f185728e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.230014 Jun 23 22:46:06.768105 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 73/151] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:06 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:06.788128 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-4ea8d8d1-1b5a-4d06-bdca-82bfdb3b3f59 req-a7a3cb2b-6ada-4e2a-9181-a53df2084d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7185d851-3beb-40db-9d52-d401b0db2367", "name": "network-vif-plugged", "status": "completed", "tag": "ef90cb7d-19ed-4cbb-8b5b-b499ea919109"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:06.797188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4ea8d8d1-1b5a-4d06-bdca-82bfdb3b3f59 req-a7a3cb2b-6ada-4e2a-9181-a53df2084d24 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.797624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4ea8d8d1-1b5a-4d06-bdca-82bfdb3b3f59 req-a7a3cb2b-6ada-4e2a-9181-a53df2084d24 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.808989 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-4ea8d8d1-1b5a-4d06-bdca-82bfdb3b3f59 req-a7a3cb2b-6ada-4e2a-9181-a53df2084d24 service nova] Creating event network-vif-plugged:ef90cb7d-19ed-4cbb-8b5b-b499ea919109 for instance 7185d851-3beb-40db-9d52-d401b0db2367 on hv-cinder-81322 Jun 23 22:46:06.813972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-4ea8d8d1-1b5a-4d06-bdca-82bfdb3b3f59 req-a7a3cb2b-6ada-4e2a-9181-a53df2084d24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106990 Jun 23 22:46:06.814555 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 79/152] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:06.948519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-614b931d-beb9-445e-b774-5e140d1851d8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:06.949159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-614b931d-beb9-445e-b774-5e140d1851d8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:06.955420 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-614b931d-beb9-445e-b774-5e140d1851d8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.955883 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-614b931d-beb9-445e-b774-5e140d1851d8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.956659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-614b931d-beb9-445e-b774-5e140d1851d8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:06.957089 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-614b931d-beb9-445e-b774-5e140d1851d8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:06.999383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:07.000023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:07.006374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:07.006824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:07.007580 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:07.008006 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:07.093076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-614b931d-beb9-445e-b774-5e140d1851d8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.103240 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-614b931d-beb9-445e-b774-5e140d1851d8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.158131 Jun 23 22:46:07.104035 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 74/153] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:06 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:07.153269 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.163213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.165679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.166890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-48820e38-4b92-4fd9-ae71-98bb122ca26e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.172124 Jun 23 22:46:07.167533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 80/154] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:06 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:07.713706 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3f8337b2-0e9e-4845-b610-0a3eb9784e92 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:07.714341 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3f8337b2-0e9e-4845-b610-0a3eb9784e92 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:07.716162 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:07.721082 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f8337b2-0e9e-4845-b610-0a3eb9784e92 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:07.721526 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f8337b2-0e9e-4845-b610-0a3eb9784e92 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:07.722275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f8337b2-0e9e-4845-b610-0a3eb9784e92 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:07.722711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f8337b2-0e9e-4845-b610-0a3eb9784e92 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:07.775438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bcb89d77-4f9e-4a29-9ae8-5a81db6d5c4c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:07.775973 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bcb89d77-4f9e-4a29-9ae8-5a81db6d5c4c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:07.783196 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bcb89d77-4f9e-4a29-9ae8-5a81db6d5c4c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:07.783638 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bcb89d77-4f9e-4a29-9ae8-5a81db6d5c4c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:07.784454 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bcb89d77-4f9e-4a29-9ae8-5a81db6d5c4c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:07.784889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bcb89d77-4f9e-4a29-9ae8-5a81db6d5c4c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:07.855831 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3f8337b2-0e9e-4845-b610-0a3eb9784e92 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.863263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3f8337b2-0e9e-4845-b610-0a3eb9784e92 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.153986 Jun 23 22:46:07.863901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 75/155] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:07 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:07.910223 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bcb89d77-4f9e-4a29-9ae8-5a81db6d5c4c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:07.918195 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bcb89d77-4f9e-4a29-9ae8-5a81db6d5c4c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.146828 Jun 23 22:46:07.918840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 81/156] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:07 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:08.120318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ae5fbc06-2937-4b83-b093-f1119c24af17 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:08.120952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ae5fbc06-2937-4b83-b093-f1119c24af17 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:08.123028 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:08.128041 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ae5fbc06-2937-4b83-b093-f1119c24af17 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.128535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ae5fbc06-2937-4b83-b093-f1119c24af17 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.129334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ae5fbc06-2937-4b83-b093-f1119c24af17 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.129798 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ae5fbc06-2937-4b83-b093-f1119c24af17 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.184752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:08.185553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:08.191814 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.192264 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.193086 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.193535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.256593 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ae5fbc06-2937-4b83-b093-f1119c24af17 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:08.264187 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ae5fbc06-2937-4b83-b093-f1119c24af17 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.148015 Jun 23 22:46:08.264777 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 76/157] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:08 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:08.326661 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:08.334600 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:08.336122 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:08.337869 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5cfc3a26-202b-4f49-8940-b6700ddd813a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.156769 Jun 23 22:46:08.338403 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 82/158] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:08 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:08.880848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cc80e38f-7038-41d6-9ac2-f2c7db5085c9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:08.881456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cc80e38f-7038-41d6-9ac2-f2c7db5085c9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:08.887682 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cc80e38f-7038-41d6-9ac2-f2c7db5085c9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.888070 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cc80e38f-7038-41d6-9ac2-f2c7db5085c9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.888852 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cc80e38f-7038-41d6-9ac2-f2c7db5085c9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.889287 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cc80e38f-7038-41d6-9ac2-f2c7db5085c9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.934803 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6c63d4ea-41b5-4c01-a88a-96b7a3938308 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:08.935409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6c63d4ea-41b5-4c01-a88a-96b7a3938308 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:08.941409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c63d4ea-41b5-4c01-a88a-96b7a3938308 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.941854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c63d4ea-41b5-4c01-a88a-96b7a3938308 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:08.942603 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c63d4ea-41b5-4c01-a88a-96b7a3938308 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:08.943041 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6c63d4ea-41b5-4c01-a88a-96b7a3938308 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:09.042530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cc80e38f-7038-41d6-9ac2-f2c7db5085c9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:09.055992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cc80e38f-7038-41d6-9ac2-f2c7db5085c9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.178992 Jun 23 22:46:09.056987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 77/159] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:08 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:09.095625 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6c63d4ea-41b5-4c01-a88a-96b7a3938308 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:09.103981 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6c63d4ea-41b5-4c01-a88a-96b7a3938308 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.173079 Jun 23 22:46:09.104555 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 83/160] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:08 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:09.281673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a86d0a82-3e90-44d0-89f3-b4ced11a908c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:09.282811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a86d0a82-3e90-44d0-89f3-b4ced11a908c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:09.292150 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a86d0a82-3e90-44d0-89f3-b4ced11a908c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:09.292625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a86d0a82-3e90-44d0-89f3-b4ced11a908c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:09.293431 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a86d0a82-3e90-44d0-89f3-b4ced11a908c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:09.293866 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a86d0a82-3e90-44d0-89f3-b4ced11a908c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:09.356026 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:09.356679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:09.363105 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:09.363528 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:09.364277 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:09.365276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:09.462624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a86d0a82-3e90-44d0-89f3-b4ced11a908c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:09.471068 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a86d0a82-3e90-44d0-89f3-b4ced11a908c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.193214 Jun 23 22:46:09.471640 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 78/161] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:09 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:09.528342 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:09.537813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:09.539353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:09.540622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-da0fba38-4324-4b7d-92ea-e83285e78ff4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.188762 Jun 23 22:46:09.541188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 84/162] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:09 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:10.073313 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3ee302bc-5c7a-4f74-b717-e9d3e5bd311f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:10.074215 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3ee302bc-5c7a-4f74-b717-e9d3e5bd311f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:10.086893 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3ee302bc-5c7a-4f74-b717-e9d3e5bd311f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:10.090300 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3ee302bc-5c7a-4f74-b717-e9d3e5bd311f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.091356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3ee302bc-5c7a-4f74-b717-e9d3e5bd311f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:10.093414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3ee302bc-5c7a-4f74-b717-e9d3e5bd311f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.121295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-94046bee-6e22-4dd3-8ef3-bf60b9b6a9dd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:10.122731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-94046bee-6e22-4dd3-8ef3-bf60b9b6a9dd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:10.134365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94046bee-6e22-4dd3-8ef3-bf60b9b6a9dd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:10.136947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94046bee-6e22-4dd3-8ef3-bf60b9b6a9dd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.136947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94046bee-6e22-4dd3-8ef3-bf60b9b6a9dd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:10.139116 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94046bee-6e22-4dd3-8ef3-bf60b9b6a9dd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.388855 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3ee302bc-5c7a-4f74-b717-e9d3e5bd311f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.401325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3ee302bc-5c7a-4f74-b717-e9d3e5bd311f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.331331 Jun 23 22:46:10.402380 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 79/163] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:10 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:10.487486 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3e37fd8c-c1c3-47cb-aba7-fb0ebfc7a7e9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:10.488108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3e37fd8c-c1c3-47cb-aba7-fb0ebfc7a7e9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:10.495494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e37fd8c-c1c3-47cb-aba7-fb0ebfc7a7e9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:10.495947 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e37fd8c-c1c3-47cb-aba7-fb0ebfc7a7e9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.497021 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e37fd8c-c1c3-47cb-aba7-fb0ebfc7a7e9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:10.497531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e37fd8c-c1c3-47cb-aba7-fb0ebfc7a7e9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.762488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3e37fd8c-c1c3-47cb-aba7-fb0ebfc7a7e9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.773588 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3e37fd8c-c1c3-47cb-aba7-fb0ebfc7a7e9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.289938 Jun 23 22:46:10.775239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 80/164] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:10 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:10.780927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:10.782815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:10.790638 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:10.791183 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.792022 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:10.792543 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:10.823879 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-94046bee-6e22-4dd3-8ef3-bf60b9b6a9dd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.832326 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-94046bee-6e22-4dd3-8ef3-bf60b9b6a9dd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.715633 Jun 23 22:46:10.842738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 85/165] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:10 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:10.948619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.956890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.958470 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:10.959829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e4e8cccc-fc07-489c-81d1-2b58335ebc9d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.183321 Jun 23 22:46:10.960326 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 81/166] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:10 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:11.396383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-51dd629b-f2a5-4084-97c4-91b5f9f19631 req-9f67077d-1419-4399-b393-5e945a699c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8042229-5eb7-4d72-a37f-d3d15dff51b8", "name": "network-vif-plugged", "status": "completed", "tag": "82d58367-4f7b-41b7-82c3-2460e09a1f13"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:11.405189 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-51dd629b-f2a5-4084-97c4-91b5f9f19631 req-9f67077d-1419-4399-b393-5e945a699c03 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.405844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-51dd629b-f2a5-4084-97c4-91b5f9f19631 req-9f67077d-1419-4399-b393-5e945a699c03 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.419368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-51dd629b-f2a5-4084-97c4-91b5f9f19631 req-9f67077d-1419-4399-b393-5e945a699c03 service nova] Creating event network-vif-plugged:82d58367-4f7b-41b7-82c3-2460e09a1f13 for instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 on hv-cinder-81322 Jun 23 22:46:11.422951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-61263623-4f17-447f-873b-888c9cc725c3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:11.423565 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-61263623-4f17-447f-873b-888c9cc725c3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:11.425743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-51dd629b-f2a5-4084-97c4-91b5f9f19631 req-9f67077d-1419-4399-b393-5e945a699c03 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032987 Jun 23 22:46:11.426401 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 86/167] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:11.434353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-61263623-4f17-447f-873b-888c9cc725c3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.435214 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-61263623-4f17-447f-873b-888c9cc725c3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.436174 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-61263623-4f17-447f-873b-888c9cc725c3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.436806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-61263623-4f17-447f-873b-888c9cc725c3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.603404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-61263623-4f17-447f-873b-888c9cc725c3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:11.620426 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-61263623-4f17-447f-873b-888c9cc725c3 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.201391 Jun 23 22:46:11.622003 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 82/168] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:11 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:11.792073 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-939fdc9e-3aa5-479d-af94-36763c328f19 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:11.792876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-939fdc9e-3aa5-479d-af94-36763c328f19 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:11.801512 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-939fdc9e-3aa5-479d-af94-36763c328f19 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.804339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-939fdc9e-3aa5-479d-af94-36763c328f19 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.804339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-939fdc9e-3aa5-479d-af94-36763c328f19 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.805933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-939fdc9e-3aa5-479d-af94-36763c328f19 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.850304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c8dc1fde-8fa4-4509-8e8f-8208a40a552c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:11.851001 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c8dc1fde-8fa4-4509-8e8f-8208a40a552c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:11.859600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c8dc1fde-8fa4-4509-8e8f-8208a40a552c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.861961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c8dc1fde-8fa4-4509-8e8f-8208a40a552c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.862829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c8dc1fde-8fa4-4509-8e8f-8208a40a552c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:11.865006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c8dc1fde-8fa4-4509-8e8f-8208a40a552c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:11.909852 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:12.059695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-939fdc9e-3aa5-479d-af94-36763c328f19 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.071652 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-939fdc9e-3aa5-479d-af94-36763c328f19 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.282608 Jun 23 22:46:12.083740 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 87/169] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:11 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:12.092111 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:12.093009 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:12.093264 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c8dc1fde-8fa4-4509-8e8f-8208a40a552c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.100891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c8dc1fde-8fa4-4509-8e8f-8208a40a552c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.254749 Jun 23 22:46:12.101483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 83/170] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:11 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:12.115163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:12.115608 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:12.117037 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:12.117471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:12.284766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.292370 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.293667 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.294772 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2e8ca234-9269-4a32-b8d7-c72c961a76dc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.210545 Jun 23 22:46:12.295328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 88/171] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:12 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:12.640818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-494593ac-5cba-43ce-bf05-ca5d7a13cb8b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:12.641542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-494593ac-5cba-43ce-bf05-ca5d7a13cb8b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:12.647497 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-494593ac-5cba-43ce-bf05-ca5d7a13cb8b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:12.647937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-494593ac-5cba-43ce-bf05-ca5d7a13cb8b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:12.648709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-494593ac-5cba-43ce-bf05-ca5d7a13cb8b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:12.649188 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-494593ac-5cba-43ce-bf05-ca5d7a13cb8b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:12.788819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-494593ac-5cba-43ce-bf05-ca5d7a13cb8b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:12.796370 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-494593ac-5cba-43ce-bf05-ca5d7a13cb8b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.159592 Jun 23 22:46:12.797090 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 84/172] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:12 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:13.088879 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c67f8f7f-795b-4110-b908-1c500cea94c4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:13.089483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c67f8f7f-795b-4110-b908-1c500cea94c4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:13.095548 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f8f7f-795b-4110-b908-1c500cea94c4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.095987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f8f7f-795b-4110-b908-1c500cea94c4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.096829 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f8f7f-795b-4110-b908-1c500cea94c4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.097257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c67f8f7f-795b-4110-b908-1c500cea94c4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.119135 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8fc830b6-0b53-49ca-9772-1b59efd3427f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:13.119779 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8fc830b6-0b53-49ca-9772-1b59efd3427f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:13.126108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8fc830b6-0b53-49ca-9772-1b59efd3427f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.126558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8fc830b6-0b53-49ca-9772-1b59efd3427f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.127322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8fc830b6-0b53-49ca-9772-1b59efd3427f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.127758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8fc830b6-0b53-49ca-9772-1b59efd3427f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.226186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c67f8f7f-795b-4110-b908-1c500cea94c4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.234507 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c67f8f7f-795b-4110-b908-1c500cea94c4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.149645 Jun 23 22:46:13.235298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 89/173] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:13 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:13.267043 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8fc830b6-0b53-49ca-9772-1b59efd3427f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.275038 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8fc830b6-0b53-49ca-9772-1b59efd3427f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.160616 Jun 23 22:46:13.275673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 85/174] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:13 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:13.312551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:13.313186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:13.316278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:13.319619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.320058 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.320818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.321536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.450236 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.458049 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.459549 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.460679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2f94479e-c58a-4ceb-90d5-c20eeb4df228 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.152014 Jun 23 22:46:13.461232 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 90/175] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:13 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:13.468505 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-9fb08575-4e2c-4975-b951-dc8111f3525c req-583d9027-786e-4674-8828-139614300285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973339fb-cfbd-4b97-97cd-db9e6e1464f3", "name": "network-vif-plugged", "status": "completed", "tag": "676858b6-7682-4a1b-a92a-78faad862938"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:13.476479 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-9fb08575-4e2c-4975-b951-dc8111f3525c req-583d9027-786e-4674-8828-139614300285 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.476950 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-9fb08575-4e2c-4975-b951-dc8111f3525c req-583d9027-786e-4674-8828-139614300285 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.488157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-9fb08575-4e2c-4975-b951-dc8111f3525c req-583d9027-786e-4674-8828-139614300285 service nova] Creating event network-vif-plugged:676858b6-7682-4a1b-a92a-78faad862938 for instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 on hv-cinder-81322 Jun 23 22:46:13.493131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-9fb08575-4e2c-4975-b951-dc8111f3525c req-583d9027-786e-4674-8828-139614300285 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028099 Jun 23 22:46:13.493696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 86/176] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:13.814730 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a6036bc0-ee1d-45d4-9413-ac67ebce8833 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:13.817732 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a6036bc0-ee1d-45d4-9413-ac67ebce8833 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:13.822271 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6036bc0-ee1d-45d4-9413-ac67ebce8833 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.822714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6036bc0-ee1d-45d4-9413-ac67ebce8833 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.823468 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6036bc0-ee1d-45d4-9413-ac67ebce8833 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:13.823902 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6036bc0-ee1d-45d4-9413-ac67ebce8833 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:13.956626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a6036bc0-ee1d-45d4-9413-ac67ebce8833 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:13.964725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a6036bc0-ee1d-45d4-9413-ac67ebce8833 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.153843 Jun 23 22:46:13.965268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 91/177] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:13 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:14.252195 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bf12a64c-e7d8-4498-a0a3-daf2b1f4c5bb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:14.252923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-bf12a64c-e7d8-4498-a0a3-daf2b1f4c5bb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:14.259868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bf12a64c-e7d8-4498-a0a3-daf2b1f4c5bb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.260310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bf12a64c-e7d8-4498-a0a3-daf2b1f4c5bb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.261089 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bf12a64c-e7d8-4498-a0a3-daf2b1f4c5bb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.261521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bf12a64c-e7d8-4498-a0a3-daf2b1f4c5bb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.291538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cd6f0a54-d326-47f0-ad30-7ae0de325577 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:14.292147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cd6f0a54-d326-47f0-ad30-7ae0de325577 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:14.298314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cd6f0a54-d326-47f0-ad30-7ae0de325577 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.298760 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cd6f0a54-d326-47f0-ad30-7ae0de325577 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.299516 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cd6f0a54-d326-47f0-ad30-7ae0de325577 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.299948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cd6f0a54-d326-47f0-ad30-7ae0de325577 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.391012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bf12a64c-e7d8-4498-a0a3-daf2b1f4c5bb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:14.398557 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-bf12a64c-e7d8-4498-a0a3-daf2b1f4c5bb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.150671 Jun 23 22:46:14.399217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 87/178] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:14 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:14.431541 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cd6f0a54-d326-47f0-ad30-7ae0de325577 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:14.438817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cd6f0a54-d326-47f0-ad30-7ae0de325577 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.150967 Jun 23 22:46:14.439374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 92/179] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:14 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:14.479472 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:14.480070 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:14.486066 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.486501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.487242 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.487666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.613534 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:14.622493 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:14.624000 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:14.625129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-bc6f02e9-8c86-4051-98eb-7d46e9187cf4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.150070 Jun 23 22:46:14.625676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 88/180] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:14 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:14.981820 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-55a60a8f-0d2b-4fc2-96f1-0ebd1b4ec024 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:14.982431 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-55a60a8f-0d2b-4fc2-96f1-0ebd1b4ec024 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:14.988977 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55a60a8f-0d2b-4fc2-96f1-0ebd1b4ec024 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.989425 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55a60a8f-0d2b-4fc2-96f1-0ebd1b4ec024 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:14.990179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55a60a8f-0d2b-4fc2-96f1-0ebd1b4ec024 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:14.990694 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55a60a8f-0d2b-4fc2-96f1-0ebd1b4ec024 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.138199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-55a60a8f-0d2b-4fc2-96f1-0ebd1b4ec024 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.146070 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-55a60a8f-0d2b-4fc2-96f1-0ebd1b4ec024 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.168625 Jun 23 22:46:15.146740 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 93/181] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:14 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:15.415286 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8aa7cb24-13e4-4f0d-bc3f-15e1ce4b8261 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:15.415891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8aa7cb24-13e4-4f0d-bc3f-15e1ce4b8261 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:15.421972 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8aa7cb24-13e4-4f0d-bc3f-15e1ce4b8261 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:15.422415 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8aa7cb24-13e4-4f0d-bc3f-15e1ce4b8261 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.423167 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8aa7cb24-13e4-4f0d-bc3f-15e1ce4b8261 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:15.423595 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8aa7cb24-13e4-4f0d-bc3f-15e1ce4b8261 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.464414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ea3260b5-40d9-4ca8-a0ac-fcb3bc0253b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:15.467964 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ea3260b5-40d9-4ca8-a0ac-fcb3bc0253b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:15.475469 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea3260b5-40d9-4ca8-a0ac-fcb3bc0253b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:15.476032 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea3260b5-40d9-4ca8-a0ac-fcb3bc0253b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.477001 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea3260b5-40d9-4ca8-a0ac-fcb3bc0253b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:15.477742 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea3260b5-40d9-4ca8-a0ac-fcb3bc0253b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.594685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8aa7cb24-13e4-4f0d-bc3f-15e1ce4b8261 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.619407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8aa7cb24-13e4-4f0d-bc3f-15e1ce4b8261 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.207813 Jun 23 22:46:15.620004 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 89/182] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:15 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:15.642666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:15.643472 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:15.651142 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:15.651833 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ea3260b5-40d9-4ca8-a0ac-fcb3bc0253b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.652177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.653226 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:15.654773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:15.665473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ea3260b5-40d9-4ca8-a0ac-fcb3bc0253b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.213098 Jun 23 22:46:15.676495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 94/183] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:15 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:15.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.799765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.801307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:15.802407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7ab9ff1a-c276-4380-bbfa-7282343a424d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.163663 Jun 23 22:46:15.802961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 90/184] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:15 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:16.163085 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8d3fd9fc-f64a-446b-9ec8-f1783ced1058 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:16.163686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8d3fd9fc-f64a-446b-9ec8-f1783ced1058 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:16.170374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d3fd9fc-f64a-446b-9ec8-f1783ced1058 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:16.170815 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d3fd9fc-f64a-446b-9ec8-f1783ced1058 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:16.171569 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d3fd9fc-f64a-446b-9ec8-f1783ced1058 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:16.171994 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d3fd9fc-f64a-446b-9ec8-f1783ced1058 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:16.306702 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8d3fd9fc-f64a-446b-9ec8-f1783ced1058 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:16.310227 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:16.314466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8d3fd9fc-f64a-446b-9ec8-f1783ced1058 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.155247 Jun 23 22:46:16.315034 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 95/185] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:16 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:16.637263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a86f4368-26de-4c62-96b4-c0dcbd370b8f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:16.637827 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a86f4368-26de-4c62-96b4-c0dcbd370b8f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:16.643789 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a86f4368-26de-4c62-96b4-c0dcbd370b8f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:16.644235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a86f4368-26de-4c62-96b4-c0dcbd370b8f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:16.645022 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a86f4368-26de-4c62-96b4-c0dcbd370b8f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:16.645454 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a86f4368-26de-4c62-96b4-c0dcbd370b8f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:16.682897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a26508e7-a1c9-46c1-bb21-47fbe32fb3a9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:16.684132 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a26508e7-a1c9-46c1-bb21-47fbe32fb3a9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:16.691096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a26508e7-a1c9-46c1-bb21-47fbe32fb3a9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:16.691550 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a26508e7-a1c9-46c1-bb21-47fbe32fb3a9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:16.692399 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a26508e7-a1c9-46c1-bb21-47fbe32fb3a9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:16.693015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a26508e7-a1c9-46c1-bb21-47fbe32fb3a9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:16.797394 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a86f4368-26de-4c62-96b4-c0dcbd370b8f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:16.805750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a86f4368-26de-4c62-96b4-c0dcbd370b8f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.171950 Jun 23 22:46:16.806332 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 91/186] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:16 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:16.820257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:16.821282 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:16.827255 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:16.827695 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:16.828447 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:16.828921 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:16.833902 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a26508e7-a1c9-46c1-bb21-47fbe32fb3a9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:16.841913 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a26508e7-a1c9-46c1-bb21-47fbe32fb3a9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.163590 Jun 23 22:46:16.845301 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 96/187] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:16 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:16.956050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:16.964567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:16.966077 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:16.967164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-53da99fc-216f-48f9-b55e-2db85a667fe0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.150763 Jun 23 22:46:16.967750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 92/188] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:16 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:17.333027 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1b8cfe3f-9198-48c6-b218-f8f093f68a96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:17.333640 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1b8cfe3f-9198-48c6-b218-f8f093f68a96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:17.340263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b8cfe3f-9198-48c6-b218-f8f093f68a96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:17.340741 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b8cfe3f-9198-48c6-b218-f8f093f68a96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:17.341483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b8cfe3f-9198-48c6-b218-f8f093f68a96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:17.342075 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1b8cfe3f-9198-48c6-b218-f8f093f68a96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:17.470681 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1b8cfe3f-9198-48c6-b218-f8f093f68a96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:17.478103 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1b8cfe3f-9198-48c6-b218-f8f093f68a96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.148885 Jun 23 22:46:17.478659 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 97/189] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:17 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:17.823324 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-296dba6d-15f9-4360-bcf0-98e35612b872 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:17.823955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-296dba6d-15f9-4360-bcf0-98e35612b872 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:17.829932 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-296dba6d-15f9-4360-bcf0-98e35612b872 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:17.830371 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-296dba6d-15f9-4360-bcf0-98e35612b872 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:17.831113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-296dba6d-15f9-4360-bcf0-98e35612b872 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:17.831541 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-296dba6d-15f9-4360-bcf0-98e35612b872 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:17.858981 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-700ae6d8-abdc-41a1-b4c9-3c6d433ccd45 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:17.859611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-700ae6d8-abdc-41a1-b4c9-3c6d433ccd45 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:17.865611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-700ae6d8-abdc-41a1-b4c9-3c6d433ccd45 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:17.866051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-700ae6d8-abdc-41a1-b4c9-3c6d433ccd45 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:17.866796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-700ae6d8-abdc-41a1-b4c9-3c6d433ccd45 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:17.867221 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-700ae6d8-abdc-41a1-b4c9-3c6d433ccd45 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:17.962066 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-296dba6d-15f9-4360-bcf0-98e35612b872 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:17.969626 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-296dba6d-15f9-4360-bcf0-98e35612b872 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.150897 Jun 23 22:46:17.970187 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 93/190] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:17 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:17.985446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:17.986054 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:17.992119 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.000538 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:18.000538 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.000538 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:18.000826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-700ae6d8-abdc-41a1-b4c9-3c6d433ccd45 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:18.002881 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-700ae6d8-abdc-41a1-b4c9-3c6d433ccd45 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1321 microversion: 2.1 time: 0.147692 Jun 23 22:46:18.003439 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 98/191] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:17 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:18.121969 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:18.129870 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:18.131377 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:18.132475 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-81114862-73ea-4036-a720-c445b46d5459 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.150841 Jun 23 22:46:18.133063 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 94/192] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:17 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:18.493875 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-022faf2a-31cf-4b89-b92b-500e12506384 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:18.495470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-022faf2a-31cf-4b89-b92b-500e12506384 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:18.501834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-022faf2a-31cf-4b89-b92b-500e12506384 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.502285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-022faf2a-31cf-4b89-b92b-500e12506384 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:18.503051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-022faf2a-31cf-4b89-b92b-500e12506384 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.503499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-022faf2a-31cf-4b89-b92b-500e12506384 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:18.639732 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-022faf2a-31cf-4b89-b92b-500e12506384 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:18.647276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-022faf2a-31cf-4b89-b92b-500e12506384 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.157273 Jun 23 22:46:18.647829 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 99/193] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:18 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:18.987038 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-37f51741-a0ec-492c-9e51-be5968cbcf73 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:18.987675 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-37f51741-a0ec-492c-9e51-be5968cbcf73 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:18.993832 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-37f51741-a0ec-492c-9e51-be5968cbcf73 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:18.994274 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-37f51741-a0ec-492c-9e51-be5968cbcf73 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.002258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-37f51741-a0ec-492c-9e51-be5968cbcf73 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.002258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-37f51741-a0ec-492c-9e51-be5968cbcf73 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.020716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c393d063-13fb-4d8c-bb33-da0295922144 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:19.021938 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c393d063-13fb-4d8c-bb33-da0295922144 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:19.028747 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c393d063-13fb-4d8c-bb33-da0295922144 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.034330 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c393d063-13fb-4d8c-bb33-da0295922144 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.034330 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c393d063-13fb-4d8c-bb33-da0295922144 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.034330 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c393d063-13fb-4d8c-bb33-da0295922144 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.143365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-37f51741-a0ec-492c-9e51-be5968cbcf73 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.154558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-37f51741-a0ec-492c-9e51-be5968cbcf73 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1366 microversion: 2.1 time: 0.170531 Jun 23 22:46:19.158548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 95/194] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:18 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:19.173020 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:19.173820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:19.180777 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.181740 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.183127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.183811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.189174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c393d063-13fb-4d8c-bb33-da0295922144 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.199759 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c393d063-13fb-4d8c-bb33-da0295922144 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1514 microversion: 2.1 time: 0.183540 Jun 23 22:46:19.200807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 100/195] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:19 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:19.217374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7236818d-76fc-4220-abfb-1dfda4570201 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:19.218776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7236818d-76fc-4220-abfb-1dfda4570201 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:19.225685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7236818d-76fc-4220-abfb-1dfda4570201 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.226368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7236818d-76fc-4220-abfb-1dfda4570201 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.227298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7236818d-76fc-4220-abfb-1dfda4570201 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.227922 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7236818d-76fc-4220-abfb-1dfda4570201 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.326349 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-7236818d-76fc-4220-abfb-1dfda4570201 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lazy-loading 'flavor' on Instance uuid 7185d851-3beb-40db-9d52-d401b0db2367 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:46:19.405918 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.417194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.418715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.419895 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-be2377e3-ffab-4b4a-b022-911da391b7f5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.259912 Jun 23 22:46:19.420610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 96/196] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:19 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:19.474240 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-0b1b0915-0bd8-4699-a8da-b05efe7fc890 req-afc2bba8-a2bc-477f-b913-ae5a34b78b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192d5777-a83f-473b-bc1d-6ae78bd7326c", "name": "network-vif-plugged", "status": "completed", "tag": "f65b1997-349a-4f3b-8290-efaec03c5e9e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:19.492840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-0b1b0915-0bd8-4699-a8da-b05efe7fc890 req-afc2bba8-a2bc-477f-b913-ae5a34b78b28 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.493862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-0b1b0915-0bd8-4699-a8da-b05efe7fc890 req-afc2bba8-a2bc-477f-b913-ae5a34b78b28 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.506148 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-0b1b0915-0bd8-4699-a8da-b05efe7fc890 req-afc2bba8-a2bc-477f-b913-ae5a34b78b28 service nova] Creating event network-vif-plugged:f65b1997-349a-4f3b-8290-efaec03c5e9e for instance 192d5777-a83f-473b-bc1d-6ae78bd7326c on hv-cinder-81322 Jun 23 22:46:19.514578 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-0b1b0915-0bd8-4699-a8da-b05efe7fc890 req-afc2bba8-a2bc-477f-b913-ae5a34b78b28 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049346 Jun 23 22:46:19.527677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 97/197] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:46:19.665095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-88a500dc-41d3-4ec5-9512-3e97f9bc9317 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:19.666105 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-88a500dc-41d3-4ec5-9512-3e97f9bc9317 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:19.676021 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-88a500dc-41d3-4ec5-9512-3e97f9bc9317 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.676463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-88a500dc-41d3-4ec5-9512-3e97f9bc9317 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.677314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-88a500dc-41d3-4ec5-9512-3e97f9bc9317 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.677898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-88a500dc-41d3-4ec5-9512-3e97f9bc9317 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.764561 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7236818d-76fc-4220-abfb-1dfda4570201 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367/action" status: 200 len: 32 microversion: 2.1 time: 0.548587 Jun 23 22:46:19.767001 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 101/198] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:46:19 2022] POST /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367/action => generated 32 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:46:19.801602 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e4609743-7a86-45d0-ae9a-bfcf5eaa2e95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:19.801602 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e4609743-7a86-45d0-ae9a-bfcf5eaa2e95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:19.809821 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4609743-7a86-45d0-ae9a-bfcf5eaa2e95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.810943 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4609743-7a86-45d0-ae9a-bfcf5eaa2e95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.812200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4609743-7a86-45d0-ae9a-bfcf5eaa2e95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:19.812924 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4609743-7a86-45d0-ae9a-bfcf5eaa2e95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:19.921151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-88a500dc-41d3-4ec5-9512-3e97f9bc9317 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:19.930797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-88a500dc-41d3-4ec5-9512-3e97f9bc9317 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.270886 Jun 23 22:46:19.941236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 98/199] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:19 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:19.999613 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4609743-7a86-45d0-ae9a-bfcf5eaa2e95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.007402 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e4609743-7a86-45d0-ae9a-bfcf5eaa2e95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.234951 Jun 23 22:46:20.008009 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 102/200] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:19 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:20.177123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9d438f96-a76d-43e6-a856-526d20f175ae tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:20.177123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9d438f96-a76d-43e6-a856-526d20f175ae tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:20.183584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9d438f96-a76d-43e6-a856-526d20f175ae tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.184026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9d438f96-a76d-43e6-a856-526d20f175ae tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.184847 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9d438f96-a76d-43e6-a856-526d20f175ae tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.185275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9d438f96-a76d-43e6-a856-526d20f175ae tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.319553 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9d438f96-a76d-43e6-a856-526d20f175ae tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.327971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9d438f96-a76d-43e6-a856-526d20f175ae tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1555 microversion: 2.1 time: 0.156364 Jun 23 22:46:20.328542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 99/201] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:20 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:20.345613 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-99b06164-6d3e-4873-89bb-e04494511e75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:20.346144 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-99b06164-6d3e-4873-89bb-e04494511e75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:20.352114 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99b06164-6d3e-4873-89bb-e04494511e75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.352554 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99b06164-6d3e-4873-89bb-e04494511e75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.353444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99b06164-6d3e-4873-89bb-e04494511e75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.354045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-99b06164-6d3e-4873-89bb-e04494511e75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.446906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:20.448341 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:20.454987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.455293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.456296 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.456909 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.499522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-99b06164-6d3e-4873-89bb-e04494511e75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157759 Jun 23 22:46:20.500112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 103/202] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 22:46:20 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:20.851450 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.870397 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.872475 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:20.874589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-203a987c-6a30-4047-8c2c-8d1dca9c675b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.439298 Jun 23 22:46:20.876648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 100/203] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:20 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:20.949155 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5e0ee009-b277-46ec-a9cc-03635964c2f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:20.949913 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5e0ee009-b277-46ec-a9cc-03635964c2f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:20.963019 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e0ee009-b277-46ec-a9cc-03635964c2f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.964715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e0ee009-b277-46ec-a9cc-03635964c2f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:20.965662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e0ee009-b277-46ec-a9cc-03635964c2f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:20.967925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e0ee009-b277-46ec-a9cc-03635964c2f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.032922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-698ddcd3-1fa2-49cb-8e10-d8cfda227efb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:21.033677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-698ddcd3-1fa2-49cb-8e10-d8cfda227efb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:21.040277 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-698ddcd3-1fa2-49cb-8e10-d8cfda227efb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.041565 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-698ddcd3-1fa2-49cb-8e10-d8cfda227efb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.042499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-698ddcd3-1fa2-49cb-8e10-d8cfda227efb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.050889 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-698ddcd3-1fa2-49cb-8e10-d8cfda227efb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.081809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:21.220653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-698ddcd3-1fa2-49cb-8e10-d8cfda227efb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:21.230586 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-698ddcd3-1fa2-49cb-8e10-d8cfda227efb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.202223 Jun 23 22:46:21.231977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 101/204] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:21 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:21.528767 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-66767197-641c-4fab-a255-c1391704ecfd req-e6b14f14-c958-4f06-bf41-ff2c62f9795a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286fefab-3729-4c09-a3be-0af864c6de65", "name": "network-vif-plugged", "status": "completed", "tag": "b2734dfe-80ab-464a-85a5-81204d7db18e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:21.537142 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-66767197-641c-4fab-a255-c1391704ecfd req-e6b14f14-c958-4f06-bf41-ff2c62f9795a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.537585 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-66767197-641c-4fab-a255-c1391704ecfd req-e6b14f14-c958-4f06-bf41-ff2c62f9795a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.549318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-66767197-641c-4fab-a255-c1391704ecfd req-e6b14f14-c958-4f06-bf41-ff2c62f9795a service nova] Creating event network-vif-plugged:b2734dfe-80ab-464a-85a5-81204d7db18e for instance 286fefab-3729-4c09-a3be-0af864c6de65 on hv-cinder-81322 Jun 23 22:46:21.554191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-66767197-641c-4fab-a255-c1391704ecfd req-e6b14f14-c958-4f06-bf41-ff2c62f9795a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029357 Jun 23 22:46:21.554951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 102/205] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:46:21.569443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5e0ee009-b277-46ec-a9cc-03635964c2f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:21.578651 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5e0ee009-b277-46ec-a9cc-03635964c2f8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1314 microversion: 2.1 time: 0.634502 Jun 23 22:46:21.579258 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 104/206] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:20 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1314 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:21.983031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:21.983031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:21.983031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.983031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:21.986544 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:21.986544 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.074254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:22.082327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:22.083837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:22.084969 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5d011a93-b5ca-4102-bd16-32239618b181 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.194398 Jun 23 22:46:22.085530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 103/207] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:21 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:22.250823 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-81162364-b653-42d4-81c9-6d8ea8d6c001 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:22.251850 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-81162364-b653-42d4-81c9-6d8ea8d6c001 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:22.260418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81162364-b653-42d4-81c9-6d8ea8d6c001 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.261300 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81162364-b653-42d4-81c9-6d8ea8d6c001 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.262273 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81162364-b653-42d4-81c9-6d8ea8d6c001 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.262761 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-81162364-b653-42d4-81c9-6d8ea8d6c001 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.595488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-73529c35-7a3b-4da9-8c74-f6b8172d1ee6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:22.596081 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-73529c35-7a3b-4da9-8c74-f6b8172d1ee6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:22.606841 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-73529c35-7a3b-4da9-8c74-f6b8172d1ee6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.616353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-73529c35-7a3b-4da9-8c74-f6b8172d1ee6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.616353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-73529c35-7a3b-4da9-8c74-f6b8172d1ee6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.616353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-73529c35-7a3b-4da9-8c74-f6b8172d1ee6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.646529 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-81162364-b653-42d4-81c9-6d8ea8d6c001 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:22.656013 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-81162364-b653-42d4-81c9-6d8ea8d6c001 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.411089 Jun 23 22:46:22.669364 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 105/208] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:22 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:22.757614 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-73529c35-7a3b-4da9-8c74-f6b8172d1ee6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:22.769263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-73529c35-7a3b-4da9-8c74-f6b8172d1ee6 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1501 microversion: 2.1 time: 0.177477 Jun 23 22:46:22.773548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 104/209] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:22 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:22.776421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-5f749979-7cd4-4ae4-b0a9-38f520dceb28 req-299df79e-cd8e-43c7-b6df-27444a63f5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8042229-5eb7-4d72-a37f-d3d15dff51b8", "tag": "82d58367-4f7b-41b7-82c3-2460e09a1f13"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:22.787943 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5f749979-7cd4-4ae4-b0a9-38f520dceb28 req-299df79e-cd8e-43c7-b6df-27444a63f5f8 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:22.788379 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5f749979-7cd4-4ae4-b0a9-38f520dceb28 req-299df79e-cd8e-43c7-b6df-27444a63f5f8 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:22.802673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-5f749979-7cd4-4ae4-b0a9-38f520dceb28 req-299df79e-cd8e-43c7-b6df-27444a63f5f8 service nova] Creating event network-changed:82d58367-4f7b-41b7-82c3-2460e09a1f13 for instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 on hv-cinder-81322 Jun 23 22:46:22.808770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-5f749979-7cd4-4ae4-b0a9-38f520dceb28 req-299df79e-cd8e-43c7-b6df-27444a63f5f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037123 Jun 23 22:46:22.813821 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 106/210] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:46:23.104302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:23.104967 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:23.111226 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:23.111676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:23.112443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:23.112904 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:23.362237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:23.394548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:23.398857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:23.401963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-95ca123d-f935-4617-8f98-bc46253113ba tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.301493 Jun 23 22:46:23.416637 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 105/211] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:23 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:23.677328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-87eaa2fb-c440-4a76-8354-60dc6baca79c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:23.678136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-87eaa2fb-c440-4a76-8354-60dc6baca79c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:23.707088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87eaa2fb-c440-4a76-8354-60dc6baca79c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:23.707088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87eaa2fb-c440-4a76-8354-60dc6baca79c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:23.707779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87eaa2fb-c440-4a76-8354-60dc6baca79c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:23.709096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87eaa2fb-c440-4a76-8354-60dc6baca79c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:24.098226 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-87eaa2fb-c440-4a76-8354-60dc6baca79c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:24.107300 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-87eaa2fb-c440-4a76-8354-60dc6baca79c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.435333 Jun 23 22:46:24.112643 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 107/212] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:23 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:24.420818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:24.421605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:24.428549 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:24.428899 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:24.430002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:24.430438 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:24.596923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:24.609933 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:24.611709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:24.617210 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-72bcf265-1096-4e4a-9153-13d11aaa11de tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1407 microversion: 2.20 time: 0.197504 Jun 23 22:46:24.617210 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 106/213] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:24 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:46:24.681670 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0a20978e-1fc0-4383-b422-734f71febd96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94e3080c-a242-4a17-b044-b7c855d18c46"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:24.686240 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0a20978e-1fc0-4383-b422-734f71febd96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:24.688800 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a20978e-1fc0-4383-b422-734f71febd96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:24.689334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a20978e-1fc0-4383-b422-734f71febd96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:24.690130 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a20978e-1fc0-4383-b422-734f71febd96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:24.690418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0a20978e-1fc0-4383-b422-734f71febd96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.126272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-14bc72a4-1274-4bda-a3b0-122254f7a4e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:25.126882 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-14bc72a4-1274-4bda-a3b0-122254f7a4e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:25.133095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-14bc72a4-1274-4bda-a3b0-122254f7a4e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:25.133547 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-14bc72a4-1274-4bda-a3b0-122254f7a4e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.134747 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-14bc72a4-1274-4bda-a3b0-122254f7a4e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:25.135086 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-14bc72a4-1274-4bda-a3b0-122254f7a4e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.321795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-14bc72a4-1274-4bda-a3b0-122254f7a4e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:25.328651 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-14bc72a4-1274-4bda-a3b0-122254f7a4e6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.206168 Jun 23 22:46:25.329262 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 107/214] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:25 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:25.623890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0a20978e-1fc0-4383-b422-734f71febd96 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "POST /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946273 Jun 23 22:46:25.628317 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 108/215] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:46:24 2022] POST /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:25.633121 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:25.635339 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:25.641994 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:25.642659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.643423 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:25.644704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.780637 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:25.788566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:25.790075 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:25.791378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ae74c1c3-34d2-4921-b768-b83cc7a4c01d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1598 microversion: 2.20 time: 0.162436 Jun 23 22:46:25.791919 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 108/216] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:46:25 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:46:25.815410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9fdf8f11-2377-4b14-b9e4-65d96a61a048 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:25.816180 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9fdf8f11-2377-4b14-b9e4-65d96a61a048 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:25.826740 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fdf8f11-2377-4b14-b9e4-65d96a61a048 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:25.827595 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fdf8f11-2377-4b14-b9e4-65d96a61a048 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.828593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fdf8f11-2377-4b14-b9e4-65d96a61a048 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:25.829227 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fdf8f11-2377-4b14-b9e4-65d96a61a048 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:25.933898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9fdf8f11-2377-4b14-b9e4-65d96a61a048 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122598 Jun 23 22:46:25.935074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 109/217] 10.222.0.33 () {60 vars in 1315 bytes} [Thu Jun 23 22:46:25 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:46:26.345751 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5cba3724-049d-4c0f-a2ea-fe17dbbe6382 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:26.346356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5cba3724-049d-4c0f-a2ea-fe17dbbe6382 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:26.352852 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5cba3724-049d-4c0f-a2ea-fe17dbbe6382 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:26.354130 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5cba3724-049d-4c0f-a2ea-fe17dbbe6382 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:26.355111 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5cba3724-049d-4c0f-a2ea-fe17dbbe6382 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:26.355733 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5cba3724-049d-4c0f-a2ea-fe17dbbe6382 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:26.771599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5cba3724-049d-4c0f-a2ea-fe17dbbe6382 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:26.780527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5cba3724-049d-4c0f-a2ea-fe17dbbe6382 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.437985 Jun 23 22:46:26.781175 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 109/218] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:26 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:27.336061 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-7bb85c84-7f2b-4506-96a0-29772a292eb4 req-50679f6b-4e62-4041-b4bb-0e4789572216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "286fefab-3729-4c09-a3be-0af864c6de65", "tag": "b2734dfe-80ab-464a-85a5-81204d7db18e"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:27.355907 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7bb85c84-7f2b-4506-96a0-29772a292eb4 req-50679f6b-4e62-4041-b4bb-0e4789572216 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:27.357212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7bb85c84-7f2b-4506-96a0-29772a292eb4 req-50679f6b-4e62-4041-b4bb-0e4789572216 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:27.385041 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-7bb85c84-7f2b-4506-96a0-29772a292eb4 req-50679f6b-4e62-4041-b4bb-0e4789572216 service nova] Creating event network-changed:b2734dfe-80ab-464a-85a5-81204d7db18e for instance 286fefab-3729-4c09-a3be-0af864c6de65 on hv-cinder-81322 Jun 23 22:46:27.403353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-7bb85c84-7f2b-4506-96a0-29772a292eb4 req-50679f6b-4e62-4041-b4bb-0e4789572216 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058912 Jun 23 22:46:27.404685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 110/219] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:27.799554 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-76671486-5380-4c45-9766-679e5a5d9ff9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:27.801510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-76671486-5380-4c45-9766-679e5a5d9ff9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:27.814343 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-76671486-5380-4c45-9766-679e5a5d9ff9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:27.817129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-76671486-5380-4c45-9766-679e5a5d9ff9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:27.821809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-76671486-5380-4c45-9766-679e5a5d9ff9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:27.824202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-76671486-5380-4c45-9766-679e5a5d9ff9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:28.049298 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-76671486-5380-4c45-9766-679e5a5d9ff9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:28.067258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-76671486-5380-4c45-9766-679e5a5d9ff9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.272585 Jun 23 22:46:28.069491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 110/220] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:27 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:29.091510 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7caab740-3b47-4d34-ae47-ad25d821ea8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:29.092039 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7caab740-3b47-4d34-ae47-ad25d821ea8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:29.102729 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7caab740-3b47-4d34-ae47-ad25d821ea8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:29.104920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7caab740-3b47-4d34-ae47-ad25d821ea8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:29.104920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7caab740-3b47-4d34-ae47-ad25d821ea8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:29.104920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7caab740-3b47-4d34-ae47-ad25d821ea8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:29.111408 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:29.321912 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7caab740-3b47-4d34-ae47-ad25d821ea8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:29.330162 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7caab740-3b47-4d34-ae47-ad25d821ea8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.246119 Jun 23 22:46:29.330859 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 111/221] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:29 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:30.347258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-20ffc124-3741-4dc5-9a7f-2fc7014111ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:30.347865 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-20ffc124-3741-4dc5-9a7f-2fc7014111ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:30.357076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-20ffc124-3741-4dc5-9a7f-2fc7014111ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:30.357525 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-20ffc124-3741-4dc5-9a7f-2fc7014111ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:30.358291 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-20ffc124-3741-4dc5-9a7f-2fc7014111ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:30.358724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-20ffc124-3741-4dc5-9a7f-2fc7014111ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:30.624996 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-20ffc124-3741-4dc5-9a7f-2fc7014111ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:30.636024 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-20ffc124-3741-4dc5-9a7f-2fc7014111ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.292511 Jun 23 22:46:30.645626 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 111/222] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:30 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:31.662133 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e0b1c027-395a-4931-8cc1-db27565f8075 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:31.662723 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e0b1c027-395a-4931-8cc1-db27565f8075 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:31.678793 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b1c027-395a-4931-8cc1-db27565f8075 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:31.679249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b1c027-395a-4931-8cc1-db27565f8075 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:31.680021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b1c027-395a-4931-8cc1-db27565f8075 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:31.685953 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0b1c027-395a-4931-8cc1-db27565f8075 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:32.155371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e0b1c027-395a-4931-8cc1-db27565f8075 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:32.164559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e0b1c027-395a-4931-8cc1-db27565f8075 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.507232 Jun 23 22:46:32.173965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 112/223] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:31 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:33.194608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a0d175e5-e082-40ff-bbbf-42ac6ae86c33 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:33.199298 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a0d175e5-e082-40ff-bbbf-42ac6ae86c33 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:33.211630 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a0d175e5-e082-40ff-bbbf-42ac6ae86c33 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:33.214362 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a0d175e5-e082-40ff-bbbf-42ac6ae86c33 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:33.215535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a0d175e5-e082-40ff-bbbf-42ac6ae86c33 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:33.216012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a0d175e5-e082-40ff-bbbf-42ac6ae86c33 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:33.356217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a0d175e5-e082-40ff-bbbf-42ac6ae86c33 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:33.363722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a0d175e5-e082-40ff-bbbf-42ac6ae86c33 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.179221 Jun 23 22:46:33.364294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 112/224] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:33 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:34.381716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f33ecb25-593c-4ef8-9346-145493aca217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:34.382392 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f33ecb25-593c-4ef8-9346-145493aca217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:34.396306 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f33ecb25-593c-4ef8-9346-145493aca217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:34.397099 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f33ecb25-593c-4ef8-9346-145493aca217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:34.400627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f33ecb25-593c-4ef8-9346-145493aca217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:34.402073 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f33ecb25-593c-4ef8-9346-145493aca217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:34.711150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f33ecb25-593c-4ef8-9346-145493aca217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:34.721450 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f33ecb25-593c-4ef8-9346-145493aca217 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.344520 Jun 23 22:46:34.722959 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 113/225] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:34 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:35.195254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fd755949-1b76-4d5c-9d46-8fd729bbc03f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:35.195254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fd755949-1b76-4d5c-9d46-8fd729bbc03f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:35.195254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd755949-1b76-4d5c-9d46-8fd729bbc03f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:35.195254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd755949-1b76-4d5c-9d46-8fd729bbc03f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:35.198476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd755949-1b76-4d5c-9d46-8fd729bbc03f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:35.198476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd755949-1b76-4d5c-9d46-8fd729bbc03f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:35.198476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fd755949-1b76-4d5c-9d46-8fd729bbc03f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:46:35.587033 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fd755949-1b76-4d5c-9d46-8fd729bbc03f tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "DELETE /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 204 len: 0 microversion: 2.1 time: 0.516865 Jun 23 22:46:35.587977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 113/226] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:46:35 2022] DELETE /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:46:35.596997 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-28154337-b27e-446a-8617-c505339ab99b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:35.597610 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-28154337-b27e-446a-8617-c505339ab99b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:35.606056 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28154337-b27e-446a-8617-c505339ab99b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:35.606889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28154337-b27e-446a-8617-c505339ab99b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:35.608183 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28154337-b27e-446a-8617-c505339ab99b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:35.608800 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28154337-b27e-446a-8617-c505339ab99b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:35.743314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-692ddb8e-50df-48d6-b84a-fba9b6a7f392 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:35.744416 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-692ddb8e-50df-48d6-b84a-fba9b6a7f392 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:35.754414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-692ddb8e-50df-48d6-b84a-fba9b6a7f392 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:35.756399 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-692ddb8e-50df-48d6-b84a-fba9b6a7f392 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:35.760880 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-692ddb8e-50df-48d6-b84a-fba9b6a7f392 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:35.762429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-692ddb8e-50df-48d6-b84a-fba9b6a7f392 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:35.907653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-28154337-b27e-446a-8617-c505339ab99b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:35.916919 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-28154337-b27e-446a-8617-c505339ab99b tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1553 microversion: 2.1 time: 0.324634 Jun 23 22:46:35.917510 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 114/227] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:35 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1553 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:36.348848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-692ddb8e-50df-48d6-b84a-fba9b6a7f392 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:36.355446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-692ddb8e-50df-48d6-b84a-fba9b6a7f392 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.619565 Jun 23 22:46:36.358369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 114/228] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:35 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:36.935578 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b4721161-91f1-4409-8806-e26811704959 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:36.936272 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b4721161-91f1-4409-8806-e26811704959 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:36.944671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b4721161-91f1-4409-8806-e26811704959 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:36.945136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b4721161-91f1-4409-8806-e26811704959 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:36.945929 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b4721161-91f1-4409-8806-e26811704959 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:36.946435 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b4721161-91f1-4409-8806-e26811704959 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:37.189819 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b4721161-91f1-4409-8806-e26811704959 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:37.199079 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b4721161-91f1-4409-8806-e26811704959 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1553 microversion: 2.1 time: 0.268770 Jun 23 22:46:37.212619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 115/229] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:36 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1553 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:37.375130 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f78bb498-3b53-4bfc-8ee4-7e48985d47e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:37.375913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f78bb498-3b53-4bfc-8ee4-7e48985d47e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:37.385859 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f78bb498-3b53-4bfc-8ee4-7e48985d47e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:37.386983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f78bb498-3b53-4bfc-8ee4-7e48985d47e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:37.387840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f78bb498-3b53-4bfc-8ee4-7e48985d47e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:37.388484 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f78bb498-3b53-4bfc-8ee4-7e48985d47e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:37.577086 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f78bb498-3b53-4bfc-8ee4-7e48985d47e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:37.585908 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f78bb498-3b53-4bfc-8ee4-7e48985d47e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.214674 Jun 23 22:46:37.588016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 115/230] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:37 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:38.218333 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-65b4d996-31a4-4f6c-b2b4-152ffe4276a8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:38.219714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-65b4d996-31a4-4f6c-b2b4-152ffe4276a8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:38.234744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65b4d996-31a4-4f6c-b2b4-152ffe4276a8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:38.236100 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65b4d996-31a4-4f6c-b2b4-152ffe4276a8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:38.237055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65b4d996-31a4-4f6c-b2b4-152ffe4276a8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:38.237648 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65b4d996-31a4-4f6c-b2b4-152ffe4276a8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:38.603920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-108c0bd8-9f8d-4954-96c1-eb00bf0b82eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:38.604550 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-108c0bd8-9f8d-4954-96c1-eb00bf0b82eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:38.606866 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:38.619996 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-108c0bd8-9f8d-4954-96c1-eb00bf0b82eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:38.620597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-108c0bd8-9f8d-4954-96c1-eb00bf0b82eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:38.622472 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-108c0bd8-9f8d-4954-96c1-eb00bf0b82eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:38.622922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-108c0bd8-9f8d-4954-96c1-eb00bf0b82eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:38.818163 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-108c0bd8-9f8d-4954-96c1-eb00bf0b82eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:38.830187 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-108c0bd8-9f8d-4954-96c1-eb00bf0b82eb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.228100 Jun 23 22:46:38.835897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 116/231] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:38 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:38.950313 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-65b4d996-31a4-4f6c-b2b4-152ffe4276a8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:38.953447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-65b4d996-31a4-4f6c-b2b4-152ffe4276a8 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1553 microversion: 2.1 time: 0.740583 Jun 23 22:46:38.954570 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 116/232] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:38 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1553 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:39.677779 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-7df73cfa-1abb-42cb-9b21-6a9b1ba606ed req-04b529c7-230b-4615-89d8-57a49fa9a71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "973339fb-cfbd-4b97-97cd-db9e6e1464f3", "name": "network-vif-deleted", "tag": "676858b6-7682-4a1b-a92a-78faad862938"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:39.688076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7df73cfa-1abb-42cb-9b21-6a9b1ba606ed req-04b529c7-230b-4615-89d8-57a49fa9a71a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:39.688524 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7df73cfa-1abb-42cb-9b21-6a9b1ba606ed req-04b529c7-230b-4615-89d8-57a49fa9a71a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:39.700471 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:39.702829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-7df73cfa-1abb-42cb-9b21-6a9b1ba606ed req-04b529c7-230b-4615-89d8-57a49fa9a71a service nova] Creating event network-vif-deleted:676858b6-7682-4a1b-a92a-78faad862938 for instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 on hv-cinder-81322 Jun 23 22:46:39.708965 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-7df73cfa-1abb-42cb-9b21-6a9b1ba606ed req-04b529c7-230b-4615-89d8-57a49fa9a71a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037745 Jun 23 22:46:39.709863 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 117/233] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:39.853098 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-828a0f58-6dc4-4df6-98ef-84829aa3a16c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:39.854709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-828a0f58-6dc4-4df6-98ef-84829aa3a16c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:39.877611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-828a0f58-6dc4-4df6-98ef-84829aa3a16c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:39.878190 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-828a0f58-6dc4-4df6-98ef-84829aa3a16c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:39.880527 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-828a0f58-6dc4-4df6-98ef-84829aa3a16c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:39.881015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-828a0f58-6dc4-4df6-98ef-84829aa3a16c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:39.974089 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7e06bef5-947f-4607-9e1a-6de99453c1b9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:39.975729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7e06bef5-947f-4607-9e1a-6de99453c1b9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:40.006683 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e06bef5-947f-4607-9e1a-6de99453c1b9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:40.007551 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e06bef5-947f-4607-9e1a-6de99453c1b9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:40.012880 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e06bef5-947f-4607-9e1a-6de99453c1b9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:40.015647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e06bef5-947f-4607-9e1a-6de99453c1b9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:40.145891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7e06bef5-947f-4607-9e1a-6de99453c1b9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:40.158469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7e06bef5-947f-4607-9e1a-6de99453c1b9 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1345 microversion: 2.1 time: 0.189249 Jun 23 22:46:40.163326 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 118/234] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:39 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:40.243703 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-828a0f58-6dc4-4df6-98ef-84829aa3a16c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:40.254823 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-828a0f58-6dc4-4df6-98ef-84829aa3a16c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.407108 Jun 23 22:46:40.259367 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 117/235] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:39 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:41.176937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:41.178242 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:41.190569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.191340 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.192293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.193616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.286361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a367bafd-963e-4892-9827-60de50004285 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:41.288078 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a367bafd-963e-4892-9827-60de50004285 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:41.300445 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a367bafd-963e-4892-9827-60de50004285 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.303104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a367bafd-963e-4892-9827-60de50004285 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.309562 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a367bafd-963e-4892-9827-60de50004285 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.310426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a367bafd-963e-4892-9827-60de50004285 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.329725 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:41.330556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:41.331120 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lazy-loading 'fault' on Instance uuid 973339fb-cfbd-4b97-97cd-db9e6e1464f3 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:46:41.473677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '365b889f8f1a4c5dad09364e5df705ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a35daf906b2e442c9b27cb6f83673f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:41.486867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9feb1a66-4049-4865-884a-2188c9c1efda tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 200 len: 1304 microversion: 2.1 time: 0.315404 Jun 23 22:46:41.488983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 119/236] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:41 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 1304 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:41.587446 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a367bafd-963e-4892-9827-60de50004285 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:41.605160 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a367bafd-963e-4892-9827-60de50004285 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.336273 Jun 23 22:46:41.612730 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 118/237] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:41 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:42.468083 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9abe70f8-48ba-4b46-b12d-c41b377a4759 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Action: 'create', calling method: .version_select at 0x7fbbca79b310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-546473830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLm3RM3d+FVKX9yEHOn8D21XpJ+7MxglBBZcQa8Exh27JJD24qHjqhGm0SHLFqEzZlGl3gp7pxNlt0rBS0IPB2v24TzVA3t6KGvFLOjmX5Yg525hj0gelN5G9/VN4TaQ+Q=="}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:42.488453 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-9abe70f8-48ba-4b46-b12d-c41b377a4759 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Getting quotas for project 6fdc472916934fac985e88fb6a61290b. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:46:42.496910 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-9abe70f8-48ba-4b46-b12d-c41b377a4759 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Getting quotas for user 84a5fb262284400591cf29dd13771ee7 and project 6fdc472916934fac985e88fb6a61290b. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:46:42.511115 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:42.511813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:42.526527 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.526527 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.534006 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.534463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.562329 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] HTTP exception thrown: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Request method failure captured: Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 HTTP/1.1 Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0GISsmkF0xNx04SBKVaeB30P95U5rlwToHpJ2gZz8PTmiD3TXm3uQ8evEgL2xu90E1Ntp6Xn5kQ0mAXnvKNfDtmUmebxK5-y1-WA4UE2U1WYA3NqT6wV6S7ak5mgXit9u37s_VP7SMGXX2SkqSt1kqOpCaZY-4jeyZqhnk5HhOhPY Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: a35daf906b2e442c9b27cb6f83673f0a Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:46:42.568686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a35daf906b2e442c9b27cb6f83673f0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: a35daf906b2e442c9b27cb6f83673f0a Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-DeleteServersTestJSON-18685210-project Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 365b889f8f1a4c5dad09364e5df705ba Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-DeleteServersTestJSON-18685210-project Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.570192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '973339fb-cfbd-4b97-97cd-db9e6e1464f3'} Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:46:42.570908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.572523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.576986 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Returning 404 to user: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:46:42.578173 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1310981f-0f11-49f0-bc3f-3380811100b2 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 404 len: 111 microversion: 2.1 time: 0.076509 Jun 23 22:46:42.579341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 119/238] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:42 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:46:42.623700 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2366655e-23bb-4596-a240-a176158e3b7f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:42.624606 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2366655e-23bb-4596-a240-a176158e3b7f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:42.631814 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9abe70f8-48ba-4b46-b12d-c41b377a4759 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.434876 Jun 23 22:46:42.632930 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 120/239] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:46:42 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:46:42.643552 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2366655e-23bb-4596-a240-a176158e3b7f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.646554 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2366655e-23bb-4596-a240-a176158e3b7f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.647640 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2366655e-23bb-4596-a240-a176158e3b7f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.650363 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2366655e-23bb-4596-a240-a176158e3b7f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.772690 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:42.777429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:42.794087 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.794541 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.795309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:42.796749 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:42.812198 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] HTTP exception thrown: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Request method failure captured: Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3/os-volume_attachments HTTP/1.1 Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GISsmkF0xNx04SBKVaeB30P95U5rlwToHpJ2gZz8PTmiD3TXm3uQ8evEgL2xu90E1Ntp6Xn5kQ0mAXnvKNfDtmUmebxK5-y1-WA4UE2U1WYA3NqT6wV6S7ak5mgXit9u37s_VP7SMGXX2SkqSt1kqOpCaZY-4jeyZqhnk5HhOhPY Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: a35daf906b2e442c9b27cb6f83673f0a Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:46:42.823952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a35daf906b2e442c9b27cb6f83673f0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: a35daf906b2e442c9b27cb6f83673f0a Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-DeleteServersTestJSON-18685210-project Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 365b889f8f1a4c5dad09364e5df705ba Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-DeleteServersTestJSON-18685210-project Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.825334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'server_id': '973339fb-cfbd-4b97-97cd-db9e6e1464f3'} Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:46:42.826064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:42.827085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:42.829741 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Returning 404 to user: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:46:42.830605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c4b5b766-130a-46c4-93ad-72cbb9417e49 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066171 Jun 23 22:46:42.831166 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 121/240] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:46:42 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3/os-volume_attachments => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:46:42.889861 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2366655e-23bb-4596-a240-a176158e3b7f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:42.906089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2366655e-23bb-4596-a240-a176158e3b7f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.286419 Jun 23 22:46:42.909135 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 120/241] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:42 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:43.939302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f3a0a665-941e-4990-bce1-10f222cf458a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:43.940004 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f3a0a665-941e-4990-bce1-10f222cf458a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:43.947692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f3a0a665-941e-4990-bce1-10f222cf458a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.948145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f3a0a665-941e-4990-bce1-10f222cf458a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:43.949128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f3a0a665-941e-4990-bce1-10f222cf458a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:43.949719 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f3a0a665-941e-4990-bce1-10f222cf458a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.111360 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f3a0a665-941e-4990-bce1-10f222cf458a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:44.121315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f3a0a665-941e-4990-bce1-10f222cf458a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.185845 Jun 23 22:46:44.122212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 122/242] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:43 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:44.246170 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:44.250969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:44.250969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=61 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:44.255612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.256065 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.261832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.262283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.279975 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] HTTP exception thrown: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Request method failure captured: Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 HTTP/1.1 Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0GISsmkF0xNx04SBKVaeB30P95U5rlwToHpJ2gZz8PTmiD3TXm3uQ8evEgL2xu90E1Ntp6Xn5kQ0mAXnvKNfDtmUmebxK5-y1-WA4UE2U1WYA3NqT6wV6S7ak5mgXit9u37s_VP7SMGXX2SkqSt1kqOpCaZY-4jeyZqhnk5HhOhPY Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: a35daf906b2e442c9b27cb6f83673f0a Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:46:44.281990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a35daf906b2e442c9b27cb6f83673f0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: a35daf906b2e442c9b27cb6f83673f0a Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-DeleteServersTestJSON-18685210-project Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 365b889f8f1a4c5dad09364e5df705ba Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-DeleteServersTestJSON-18685210-project Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.283430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '973339fb-cfbd-4b97-97cd-db9e6e1464f3'} Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:46:44.284168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.285437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.288001 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Returning 404 to user: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:46:44.289034 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0f528eee-ec59-4416-8abc-235ddc2d5773 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "DELETE /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 404 len: 111 microversion: 2.1 time: 0.047993 Jun 23 22:46:44.290267 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 121/243] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:46:44 2022] DELETE /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:46:44.298609 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:44.299397 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] [instance: 973339fb-cfbd-4b97-97cd-db9e6e1464f3] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:44.314585 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.315035 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.315813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:44.316244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:44.339930 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] HTTP exception thrown: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Request method failure captured: Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 HTTP/1.1 Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GISsmkF0xNx04SBKVaeB30P95U5rlwToHpJ2gZz8PTmiD3TXm3uQ8evEgL2xu90E1Ntp6Xn5kQ0mAXnvKNfDtmUmebxK5-y1-WA4UE2U1WYA3NqT6wV6S7ak5mgXit9u37s_VP7SMGXX2SkqSt1kqOpCaZY-4jeyZqhnk5HhOhPY Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: a35daf906b2e442c9b27cb6f83673f0a Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:46:44.342129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a35daf906b2e442c9b27cb6f83673f0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a35daf906b2e442c9b27cb6f83673f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: a35daf906b2e442c9b27cb6f83673f0a Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-DeleteServersTestJSON-18685210 Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-DeleteServersTestJSON-18685210-project Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 365b889f8f1a4c5dad09364e5df705ba Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-DeleteServersTestJSON-18685210-project Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.347153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '973339fb-cfbd-4b97-97cd-db9e6e1464f3'} Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:46:44.348055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. Jun 23 22:46:44.349387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:46:44.350558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] Returning 404 to user: Instance 973339fb-cfbd-4b97-97cd-db9e6e1464f3 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:46:44.350558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-34574bbb-40e9-46cc-ae30-fb401f552011 tempest-DeleteServersTestJSON-18685210 tempest-DeleteServersTestJSON-18685210-project] 10.222.0.33 "GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3" status: 404 len: 111 microversion: 2.1 time: 0.048943 Jun 23 22:46:44.350558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 123/244] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:44 2022] GET /compute/v2.1/servers/973339fb-cfbd-4b97-97cd-db9e6e1464f3 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:46:45.139401 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4e3e3fed-36a7-49e9-88ac-5b7b45d699b8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:45.140326 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4e3e3fed-36a7-49e9-88ac-5b7b45d699b8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:45.165136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e3e3fed-36a7-49e9-88ac-5b7b45d699b8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:45.165136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e3e3fed-36a7-49e9-88ac-5b7b45d699b8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:45.165136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e3e3fed-36a7-49e9-88ac-5b7b45d699b8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:45.165136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e3e3fed-36a7-49e9-88ac-5b7b45d699b8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:45.438297 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4e3e3fed-36a7-49e9-88ac-5b7b45d699b8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:45.457561 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4e3e3fed-36a7-49e9-88ac-5b7b45d699b8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.322475 Jun 23 22:46:45.468927 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 122/245] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:45 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:46.474516 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-16b4fc45-7791-4c7b-ae64-aa867ac150ee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:46.475134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-16b4fc45-7791-4c7b-ae64-aa867ac150ee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:46.489169 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-16b4fc45-7791-4c7b-ae64-aa867ac150ee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:46.491036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-16b4fc45-7791-4c7b-ae64-aa867ac150ee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:46.491923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-16b4fc45-7791-4c7b-ae64-aa867ac150ee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:46.492365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-16b4fc45-7791-4c7b-ae64-aa867ac150ee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:46.822760 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-16b4fc45-7791-4c7b-ae64-aa867ac150ee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:46.850565 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-16b4fc45-7791-4c7b-ae64-aa867ac150ee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.377002 Jun 23 22:46:46.851181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 124/246] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:46 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:47.867900 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c1ba98bf-b4b3-4cb6-87bb-0661f2837017 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:47.868729 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c1ba98bf-b4b3-4cb6-87bb-0661f2837017 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:47.888351 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1ba98bf-b4b3-4cb6-87bb-0661f2837017 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:47.889047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1ba98bf-b4b3-4cb6-87bb-0661f2837017 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:47.890015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1ba98bf-b4b3-4cb6-87bb-0661f2837017 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:47.890633 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1ba98bf-b4b3-4cb6-87bb-0661f2837017 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:48.132126 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c1ba98bf-b4b3-4cb6-87bb-0661f2837017 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:48.147835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c1ba98bf-b4b3-4cb6-87bb-0661f2837017 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.284330 Jun 23 22:46:48.153846 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 123/247] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:47 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:49.166523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2858672e-9207-433d-b47d-7b18c1e9d122 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:49.167816 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2858672e-9207-433d-b47d-7b18c1e9d122 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:49.185871 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2858672e-9207-433d-b47d-7b18c1e9d122 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:49.186321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2858672e-9207-433d-b47d-7b18c1e9d122 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:49.197695 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2858672e-9207-433d-b47d-7b18c1e9d122 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:49.198286 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2858672e-9207-433d-b47d-7b18c1e9d122 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:49.457067 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2858672e-9207-433d-b47d-7b18c1e9d122 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:49.467101 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2858672e-9207-433d-b47d-7b18c1e9d122 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.305314 Jun 23 22:46:49.483422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 125/248] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:49 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:50.497171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b6162e47-74db-4e94-999c-4e0ea7ec4c95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:50.501567 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b6162e47-74db-4e94-999c-4e0ea7ec4c95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:50.508958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6162e47-74db-4e94-999c-4e0ea7ec4c95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:50.509422 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6162e47-74db-4e94-999c-4e0ea7ec4c95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:50.514353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6162e47-74db-4e94-999c-4e0ea7ec4c95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:50.514819 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6162e47-74db-4e94-999c-4e0ea7ec4c95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:50.702751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b6162e47-74db-4e94-999c-4e0ea7ec4c95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:50.710709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b6162e47-74db-4e94-999c-4e0ea7ec4c95 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.224558 Jun 23 22:46:50.712789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 124/249] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:50 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:51.728769 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-46fe3332-dc4f-42fb-8690-94db23891c37 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:51.729403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-46fe3332-dc4f-42fb-8690-94db23891c37 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:51.735511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46fe3332-dc4f-42fb-8690-94db23891c37 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:51.735954 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46fe3332-dc4f-42fb-8690-94db23891c37 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:51.736963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46fe3332-dc4f-42fb-8690-94db23891c37 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:51.737553 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46fe3332-dc4f-42fb-8690-94db23891c37 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:51.895383 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-46fe3332-dc4f-42fb-8690-94db23891c37 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:51.907016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-46fe3332-dc4f-42fb-8690-94db23891c37 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.182251 Jun 23 22:46:51.907588 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 126/250] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:51 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:52.923907 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a056b09e-d6d8-4ce8-962c-77836a70d069 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:52.924511 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a056b09e-d6d8-4ce8-962c-77836a70d069 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:52.931570 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a056b09e-d6d8-4ce8-962c-77836a70d069 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:52.932024 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a056b09e-d6d8-4ce8-962c-77836a70d069 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:52.932818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a056b09e-d6d8-4ce8-962c-77836a70d069 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:52.933258 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a056b09e-d6d8-4ce8-962c-77836a70d069 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:53.078239 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a056b09e-d6d8-4ce8-962c-77836a70d069 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:53.086925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a056b09e-d6d8-4ce8-962c-77836a70d069 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.166231 Jun 23 22:46:53.088114 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 125/251] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:52 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:54.103902 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f9850577-ad9e-4e57-86c3-3a8cb8ab7fc8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:54.104539 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f9850577-ad9e-4e57-86c3-3a8cb8ab7fc8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:54.107011 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=4 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:46:54.118715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f9850577-ad9e-4e57-86c3-3a8cb8ab7fc8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:54.118715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f9850577-ad9e-4e57-86c3-3a8cb8ab7fc8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:54.118715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f9850577-ad9e-4e57-86c3-3a8cb8ab7fc8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:54.118715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f9850577-ad9e-4e57-86c3-3a8cb8ab7fc8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:54.251551 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f9850577-ad9e-4e57-86c3-3a8cb8ab7fc8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:54.259508 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f9850577-ad9e-4e57-86c3-3a8cb8ab7fc8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.159890 Jun 23 22:46:54.260067 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 127/252] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:54 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:46:55.276984 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dfa1bc77-399f-4fea-86e5-92319be258d4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:55.277643 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dfa1bc77-399f-4fea-86e5-92319be258d4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:55.284061 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfa1bc77-399f-4fea-86e5-92319be258d4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:55.284643 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfa1bc77-399f-4fea-86e5-92319be258d4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:55.285371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfa1bc77-399f-4fea-86e5-92319be258d4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:55.286006 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dfa1bc77-399f-4fea-86e5-92319be258d4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:55.447282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dfa1bc77-399f-4fea-86e5-92319be258d4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:55.454950 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dfa1bc77-399f-4fea-86e5-92319be258d4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.182126 Jun 23 22:46:55.455511 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 126/253] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:55 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:56.472822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-756a43c4-e80b-43db-bb7f-7e19e91f7cf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:56.473533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-756a43c4-e80b-43db-bb7f-7e19e91f7cf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:56.480424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-756a43c4-e80b-43db-bb7f-7e19e91f7cf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:56.480913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-756a43c4-e80b-43db-bb7f-7e19e91f7cf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:56.481687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-756a43c4-e80b-43db-bb7f-7e19e91f7cf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:56.482121 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-756a43c4-e80b-43db-bb7f-7e19e91f7cf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:56.653474 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-756a43c4-e80b-43db-bb7f-7e19e91f7cf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:56.670304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-756a43c4-e80b-43db-bb7f-7e19e91f7cf0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1520 microversion: 2.1 time: 0.201286 Jun 23 22:46:56.671405 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 128/254] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:56 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:56.770422 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-312405291", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "networks": [{"uuid": "943907ef-568e-43a8-9aea-901197e36bb3"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:56.837923 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] validate_networks() for [('943907ef-568e-43a8-9aea-901197e36bb3', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:46:57.223188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:46:57.223335 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:46:57.223764 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:46:57.224173 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:46:57.224611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:46:57.236247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:57.236247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:57.236247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:57.236618 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:57.260704 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Getting quotas for project cb1c26e7fcbd4c0c9bb4a68e54569e3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:46:57.265089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Getting quotas for user dd98b2a31e4c46599269684782915703 and project cb1c26e7fcbd4c0c9bb4a68e54569e3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:46:57.278573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:46:57.280947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:46:57.460065 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-36bf0cc0-1be6-41ed-acff-180d05824367 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697568 Jun 23 22:46:57.464631 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 127/255] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:46:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:46:57.475827 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4bde2d8a-3374-4c0b-953f-0c8f6cde055b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:57.476553 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4bde2d8a-3374-4c0b-953f-0c8f6cde055b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:57.534369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4bde2d8a-3374-4c0b-953f-0c8f6cde055b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:57.541916 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4bde2d8a-3374-4c0b-953f-0c8f6cde055b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1218 microversion: 2.1 time: 0.074198 Jun 23 22:46:57.542489 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 129/256] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:57 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:57.691651 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b2ce8faf-33b8-4ef5-9ba4-eaa66b4467d0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:57.692259 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b2ce8faf-33b8-4ef5-9ba4-eaa66b4467d0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:57.699076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2ce8faf-33b8-4ef5-9ba4-eaa66b4467d0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:57.699583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2ce8faf-33b8-4ef5-9ba4-eaa66b4467d0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:57.700337 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2ce8faf-33b8-4ef5-9ba4-eaa66b4467d0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:57.704244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2ce8faf-33b8-4ef5-9ba4-eaa66b4467d0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:57.845065 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b2ce8faf-33b8-4ef5-9ba4-eaa66b4467d0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:57.855091 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b2ce8faf-33b8-4ef5-9ba4-eaa66b4467d0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1500 microversion: 2.1 time: 0.167332 Jun 23 22:46:57.857645 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 128/257] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:57 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1500 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:57.875312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4d52197c-ba4d-40e3-ba7d-f3266e5f000d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:57.875312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4d52197c-ba4d-40e3-ba7d-f3266e5f000d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:57.881942 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4d52197c-ba4d-40e3-ba7d-f3266e5f000d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:57.882726 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4d52197c-ba4d-40e3-ba7d-f3266e5f000d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:57.884114 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4d52197c-ba4d-40e3-ba7d-f3266e5f000d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:57.884642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4d52197c-ba4d-40e3-ba7d-f3266e5f000d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:58.030529 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4d52197c-ba4d-40e3-ba7d-f3266e5f000d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:58.038485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4d52197c-ba4d-40e3-ba7d-f3266e5f000d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1514 microversion: 2.1 time: 0.168741 Jun 23 22:46:58.039752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 130/258] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:57 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:58.559059 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4b504496-15da-450b-bb27-2c3650b4cfcc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:58.559674 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4b504496-15da-450b-bb27-2c3650b4cfcc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:58.615896 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4b504496-15da-450b-bb27-2c3650b4cfcc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:58.623000 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4b504496-15da-450b-bb27-2c3650b4cfcc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1218 microversion: 2.1 time: 0.067874 Jun 23 22:46:58.623561 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 129/259] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:58 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:59.639766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f463770c-aefa-44ab-9c46-7d5795ac6776 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:46:59.640553 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f463770c-aefa-44ab-9c46-7d5795ac6776 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:59.647043 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f463770c-aefa-44ab-9c46-7d5795ac6776 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:59.649366 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f463770c-aefa-44ab-9c46-7d5795ac6776 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:59.650279 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f463770c-aefa-44ab-9c46-7d5795ac6776 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:59.650920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f463770c-aefa-44ab-9c46-7d5795ac6776 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:59.722654 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f463770c-aefa-44ab-9c46-7d5795ac6776 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:46:59.731224 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f463770c-aefa-44ab-9c46-7d5795ac6776 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1270 microversion: 2.1 time: 0.095893 Jun 23 22:46:59.732091 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 131/260] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:46:59 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:46:59.784150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cdf4f3d6-e9e7-44d7-9583-a2ca999cc68a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:46:59.785757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cdf4f3d6-e9e7-44d7-9583-a2ca999cc68a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:46:59.802494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdf4f3d6-e9e7-44d7-9583-a2ca999cc68a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:59.803032 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdf4f3d6-e9e7-44d7-9583-a2ca999cc68a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:59.803987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdf4f3d6-e9e7-44d7-9583-a2ca999cc68a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:46:59.804778 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cdf4f3d6-e9e7-44d7-9583-a2ca999cc68a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:46:59.830187 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-cdf4f3d6-e9e7-44d7-9583-a2ca999cc68a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lazy-loading 'flavor' on Instance uuid 192d5777-a83f-473b-bc1d-6ae78bd7326c {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:46:59.834211 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:00.154258 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cdf4f3d6-e9e7-44d7-9583-a2ca999cc68a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c/action" status: 200 len: 32 microversion: 2.1 time: 0.374245 Jun 23 22:47:00.155436 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 130/261] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:46:59 2022] POST /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c/action => generated 32 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:47:00.167977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9b68685c-1d70-4829-88ef-8d13d02e5030 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:00.169030 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9b68685c-1d70-4829-88ef-8d13d02e5030 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:00.177814 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9b68685c-1d70-4829-88ef-8d13d02e5030 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:00.178511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9b68685c-1d70-4829-88ef-8d13d02e5030 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.179602 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9b68685c-1d70-4829-88ef-8d13d02e5030 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:00.180546 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9b68685c-1d70-4829-88ef-8d13d02e5030 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.397475 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9b68685c-1d70-4829-88ef-8d13d02e5030 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:00.415357 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9b68685c-1d70-4829-88ef-8d13d02e5030 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.251636 Jun 23 22:47:00.416325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 132/262] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:00 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:00.750065 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6dfc372d-bde5-4db1-8912-a3027ab73f8c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:00.750890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6dfc372d-bde5-4db1-8912-a3027ab73f8c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:00.761178 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6dfc372d-bde5-4db1-8912-a3027ab73f8c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:00.761712 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6dfc372d-bde5-4db1-8912-a3027ab73f8c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.762580 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6dfc372d-bde5-4db1-8912-a3027ab73f8c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:00.763084 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6dfc372d-bde5-4db1-8912-a3027ab73f8c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:00.862227 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6dfc372d-bde5-4db1-8912-a3027ab73f8c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:00.876131 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6dfc372d-bde5-4db1-8912-a3027ab73f8c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1276 microversion: 2.1 time: 0.131151 Jun 23 22:47:00.876995 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 131/263] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:00 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:01.434236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-aa005c38-10ea-40ec-93fc-ebaff20fa3a5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:01.434849 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-aa005c38-10ea-40ec-93fc-ebaff20fa3a5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:01.440978 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-aa005c38-10ea-40ec-93fc-ebaff20fa3a5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:01.441430 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-aa005c38-10ea-40ec-93fc-ebaff20fa3a5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:01.442407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-aa005c38-10ea-40ec-93fc-ebaff20fa3a5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:01.443010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-aa005c38-10ea-40ec-93fc-ebaff20fa3a5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:01.596013 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-aa005c38-10ea-40ec-93fc-ebaff20fa3a5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:01.605085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-aa005c38-10ea-40ec-93fc-ebaff20fa3a5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.175858 Jun 23 22:47:01.605935 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 133/264] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:01 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:01.894705 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-da388e59-741a-4dfd-a029-0d6764aef65b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:01.895985 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-da388e59-741a-4dfd-a029-0d6764aef65b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:01.903911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da388e59-741a-4dfd-a029-0d6764aef65b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:01.904565 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da388e59-741a-4dfd-a029-0d6764aef65b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:01.909874 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da388e59-741a-4dfd-a029-0d6764aef65b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:01.909874 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da388e59-741a-4dfd-a029-0d6764aef65b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:02.331752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da388e59-741a-4dfd-a029-0d6764aef65b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:02.340279 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-da388e59-741a-4dfd-a029-0d6764aef65b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1318 microversion: 2.1 time: 0.449460 Jun 23 22:47:02.341470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 132/265] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:01 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:02.623665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a1f22ad8-c7a7-42ab-bd94-d2ce6fea8d3a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:02.624955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a1f22ad8-c7a7-42ab-bd94-d2ce6fea8d3a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:02.632812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1f22ad8-c7a7-42ab-bd94-d2ce6fea8d3a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:02.633310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1f22ad8-c7a7-42ab-bd94-d2ce6fea8d3a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:02.634246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1f22ad8-c7a7-42ab-bd94-d2ce6fea8d3a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:02.634699 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1f22ad8-c7a7-42ab-bd94-d2ce6fea8d3a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:02.675050 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-e48ebaa7-df37-42dc-8ebd-b7cffb468101 req-acbb6115-951a-4b6c-bca1-3f21bbdbf671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91ce156-8955-4253-becd-3bd35d1b030e", "tag": "ab698d23-d25f-4bae-b29e-f19d0e6de684"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:02.702593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-e48ebaa7-df37-42dc-8ebd-b7cffb468101 req-acbb6115-951a-4b6c-bca1-3f21bbdbf671 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:02.703319 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-e48ebaa7-df37-42dc-8ebd-b7cffb468101 req-acbb6115-951a-4b6c-bca1-3f21bbdbf671 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:02.715272 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-e48ebaa7-df37-42dc-8ebd-b7cffb468101 req-acbb6115-951a-4b6c-bca1-3f21bbdbf671 service nova] Creating event network-changed:ab698d23-d25f-4bae-b29e-f19d0e6de684 for instance a91ce156-8955-4253-becd-3bd35d1b030e on hv-cinder-81322 Jun 23 22:47:02.720976 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-e48ebaa7-df37-42dc-8ebd-b7cffb468101 req-acbb6115-951a-4b6c-bca1-3f21bbdbf671 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049444 Jun 23 22:47:02.721544 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 133/266] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:47:02.808496 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a1f22ad8-c7a7-42ab-bd94-d2ce6fea8d3a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:02.816409 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a1f22ad8-c7a7-42ab-bd94-d2ce6fea8d3a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.197220 Jun 23 22:47:02.817108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 134/267] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:02 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:03.359002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-873f37ad-2b87-439a-82d6-d4f783b079f2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:03.359772 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-873f37ad-2b87-439a-82d6-d4f783b079f2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:03.366246 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-873f37ad-2b87-439a-82d6-d4f783b079f2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:03.367506 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-873f37ad-2b87-439a-82d6-d4f783b079f2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:03.368279 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-873f37ad-2b87-439a-82d6-d4f783b079f2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:03.368733 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-873f37ad-2b87-439a-82d6-d4f783b079f2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:03.551410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-873f37ad-2b87-439a-82d6-d4f783b079f2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:03.560467 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-873f37ad-2b87-439a-82d6-d4f783b079f2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1318 microversion: 2.1 time: 0.205968 Jun 23 22:47:03.561087 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 134/268] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:03 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:03.834829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-75720ace-4fbe-491c-9cb8-26cf74c4ec91 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:03.836362 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-75720ace-4fbe-491c-9cb8-26cf74c4ec91 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:03.844911 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75720ace-4fbe-491c-9cb8-26cf74c4ec91 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:03.845361 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75720ace-4fbe-491c-9cb8-26cf74c4ec91 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:03.846136 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75720ace-4fbe-491c-9cb8-26cf74c4ec91 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:03.846573 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75720ace-4fbe-491c-9cb8-26cf74c4ec91 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:03.985995 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-75720ace-4fbe-491c-9cb8-26cf74c4ec91 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:03.994065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-75720ace-4fbe-491c-9cb8-26cf74c4ec91 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.163359 Jun 23 22:47:03.994897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 135/269] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:03 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:04.577277 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-73f9677a-aa30-4629-b7f0-5a7334387fa0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:04.577881 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-73f9677a-aa30-4629-b7f0-5a7334387fa0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:04.584243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73f9677a-aa30-4629-b7f0-5a7334387fa0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:04.584720 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73f9677a-aa30-4629-b7f0-5a7334387fa0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:04.586117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73f9677a-aa30-4629-b7f0-5a7334387fa0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:04.586552 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-73f9677a-aa30-4629-b7f0-5a7334387fa0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:04.742566 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-73f9677a-aa30-4629-b7f0-5a7334387fa0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:04.754757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-73f9677a-aa30-4629-b7f0-5a7334387fa0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1318 microversion: 2.1 time: 0.181270 Jun 23 22:47:04.756415 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 135/270] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:04 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:05.011752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-21910625-f4f9-4d5b-a6d5-70fe00f29db2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:05.012470 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-21910625-f4f9-4d5b-a6d5-70fe00f29db2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:05.021349 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-21910625-f4f9-4d5b-a6d5-70fe00f29db2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:05.022411 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-21910625-f4f9-4d5b-a6d5-70fe00f29db2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:05.025853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-21910625-f4f9-4d5b-a6d5-70fe00f29db2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:05.026306 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-21910625-f4f9-4d5b-a6d5-70fe00f29db2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:05.163045 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-21910625-f4f9-4d5b-a6d5-70fe00f29db2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:05.171354 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-21910625-f4f9-4d5b-a6d5-70fe00f29db2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.163790 Jun 23 22:47:05.171959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 136/271] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:05 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:05.772041 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ad4ef025-541d-4437-89b5-08d8ac54b020 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:05.772878 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ad4ef025-541d-4437-89b5-08d8ac54b020 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:05.779940 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ad4ef025-541d-4437-89b5-08d8ac54b020 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:05.780386 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ad4ef025-541d-4437-89b5-08d8ac54b020 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:05.781177 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ad4ef025-541d-4437-89b5-08d8ac54b020 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:05.781611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ad4ef025-541d-4437-89b5-08d8ac54b020 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:05.927649 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ad4ef025-541d-4437-89b5-08d8ac54b020 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:05.935779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ad4ef025-541d-4437-89b5-08d8ac54b020 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1318 microversion: 2.1 time: 0.167501 Jun 23 22:47:05.936328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 136/272] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:05 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:06.188556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3f484af1-f070-4403-9d12-77002cb919ec tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:06.189177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3f484af1-f070-4403-9d12-77002cb919ec tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:06.195055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f484af1-f070-4403-9d12-77002cb919ec tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:06.195499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f484af1-f070-4403-9d12-77002cb919ec tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:06.196248 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f484af1-f070-4403-9d12-77002cb919ec tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:06.196704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f484af1-f070-4403-9d12-77002cb919ec tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:06.214992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:06.336619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3f484af1-f070-4403-9d12-77002cb919ec tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:06.344730 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3f484af1-f070-4403-9d12-77002cb919ec tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.160018 Jun 23 22:47:06.348829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 137/273] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:06 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:06.952838 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4110f0b3-681a-4702-82a1-f780d6ad19e0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:06.953659 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4110f0b3-681a-4702-82a1-f780d6ad19e0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:06.961739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4110f0b3-681a-4702-82a1-f780d6ad19e0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:06.962233 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4110f0b3-681a-4702-82a1-f780d6ad19e0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:06.963321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4110f0b3-681a-4702-82a1-f780d6ad19e0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:06.963756 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4110f0b3-681a-4702-82a1-f780d6ad19e0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:07.070235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-beae780c-c5db-4436-916b-fcdf526118e2 req-2396409e-608b-466a-a420-eb62631af632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91ce156-8955-4253-becd-3bd35d1b030e", "name": "network-vif-plugged", "status": "completed", "tag": "ab698d23-d25f-4bae-b29e-f19d0e6de684"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:07.079657 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-beae780c-c5db-4436-916b-fcdf526118e2 req-2396409e-608b-466a-a420-eb62631af632 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:07.080185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-beae780c-c5db-4436-916b-fcdf526118e2 req-2396409e-608b-466a-a420-eb62631af632 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:07.099635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-beae780c-c5db-4436-916b-fcdf526118e2 req-2396409e-608b-466a-a420-eb62631af632 service nova] Creating event network-vif-plugged:ab698d23-d25f-4bae-b29e-f19d0e6de684 for instance a91ce156-8955-4253-becd-3bd35d1b030e on hv-cinder-81322 Jun 23 22:47:07.099635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-beae780c-c5db-4436-916b-fcdf526118e2 req-2396409e-608b-466a-a420-eb62631af632 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 Jun 23 22:47:07.099635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 138/274] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:47:07.101499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4110f0b3-681a-4702-82a1-f780d6ad19e0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:07.109307 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4110f0b3-681a-4702-82a1-f780d6ad19e0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1318 microversion: 2.1 time: 0.160950 Jun 23 22:47:07.109863 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 137/275] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:06 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:07.362970 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0d258385-a9a5-4e7a-9d93-db51a82ead52 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:07.363709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0d258385-a9a5-4e7a-9d93-db51a82ead52 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:07.370496 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0d258385-a9a5-4e7a-9d93-db51a82ead52 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:07.370958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0d258385-a9a5-4e7a-9d93-db51a82ead52 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:07.371702 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0d258385-a9a5-4e7a-9d93-db51a82ead52 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:07.372136 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0d258385-a9a5-4e7a-9d93-db51a82ead52 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:07.520304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0d258385-a9a5-4e7a-9d93-db51a82ead52 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:07.533183 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0d258385-a9a5-4e7a-9d93-db51a82ead52 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.174292 Jun 23 22:47:07.534413 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 139/276] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:07 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:08.126063 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-38dbf9a3-f01a-4a49-ad96-1397e9ea8992 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:08.126668 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-38dbf9a3-f01a-4a49-ad96-1397e9ea8992 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:08.128626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:08.134486 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38dbf9a3-f01a-4a49-ad96-1397e9ea8992 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:08.134941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38dbf9a3-f01a-4a49-ad96-1397e9ea8992 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:08.135921 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38dbf9a3-f01a-4a49-ad96-1397e9ea8992 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:08.136544 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38dbf9a3-f01a-4a49-ad96-1397e9ea8992 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:08.296084 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-38dbf9a3-f01a-4a49-ad96-1397e9ea8992 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:08.307975 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-38dbf9a3-f01a-4a49-ad96-1397e9ea8992 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1318 microversion: 2.1 time: 0.185696 Jun 23 22:47:08.308570 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 138/277] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:08 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:08.551149 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-260e88c1-b231-4e51-95a9-9bf32876d569 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:08.552077 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-260e88c1-b231-4e51-95a9-9bf32876d569 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:08.555724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:08.559408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-260e88c1-b231-4e51-95a9-9bf32876d569 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:08.560054 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-260e88c1-b231-4e51-95a9-9bf32876d569 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:08.561102 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-260e88c1-b231-4e51-95a9-9bf32876d569 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:08.561537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-260e88c1-b231-4e51-95a9-9bf32876d569 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:08.641060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-128606672", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-546473830", "security_groups": [{"name": "tempest-secgroup-smoke-1398705249"}], "block_device_mapping_v2": [{"uuid": "f94c41f0-82f7-4836-9137-cf8135cbef2e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "89376fea-def3-4053-a062-fad013e2e839"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:08.654996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:08.761548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-260e88c1-b231-4e51-95a9-9bf32876d569 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:08.769861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-260e88c1-b231-4e51-95a9-9bf32876d569 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.222986 Jun 23 22:47:08.770436 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 140/278] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:08 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:08.779079 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] validate_networks() for [('89376fea-def3-4053-a062-fad013e2e839', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:47:09.200745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:47:09.201292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:47:09.201620 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:47:09.202023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:47:09.202683 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:47:09.214192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:09.214618 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:09.215404 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:09.215832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:09.232844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Getting quotas for project 6fdc472916934fac985e88fb6a61290b. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:47:09.236813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Getting quotas for user 84a5fb262284400591cf29dd13771ee7 and project 6fdc472916934fac985e88fb6a61290b. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:47:09.323467 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:47:09.323467 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f94c41f0-82f7-4836-9137-cf8135cbef2e',volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:47:09.330329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bb40cc4c-32ae-4c50-b954-5771177d81d7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:09.331940 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-bb40cc4c-32ae-4c50-b954-5771177d81d7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:09.339919 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bb40cc4c-32ae-4c50-b954-5771177d81d7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:09.340750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bb40cc4c-32ae-4c50-b954-5771177d81d7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:09.341808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bb40cc4c-32ae-4c50-b954-5771177d81d7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:09.342622 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bb40cc4c-32ae-4c50-b954-5771177d81d7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:09.500406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bb40cc4c-32ae-4c50-b954-5771177d81d7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:09.511143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-bb40cc4c-32ae-4c50-b954-5771177d81d7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1508 microversion: 2.1 time: 0.190075 Jun 23 22:47:09.511644 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 141/279] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:09 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:09.762995 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-31549bb8-0425-4795-8db5-1d80163280de tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.128429 Jun 23 22:47:09.763737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 139/280] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:47:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 22:47:09.779477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-59dfae2b-e66f-4860-840b-5f51b6c2fa9b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:09.779477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-59dfae2b-e66f-4860-840b-5f51b6c2fa9b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:09.817442 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8dc399e3-9136-4ce5-ab02-b95da921693a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:09.818545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8dc399e3-9136-4ce5-ab02-b95da921693a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:09.831709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8dc399e3-9136-4ce5-ab02-b95da921693a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:09.832165 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8dc399e3-9136-4ce5-ab02-b95da921693a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:09.832980 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8dc399e3-9136-4ce5-ab02-b95da921693a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:09.833417 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8dc399e3-9136-4ce5-ab02-b95da921693a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:09.884731 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-59dfae2b-e66f-4860-840b-5f51b6c2fa9b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:09.898143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-59dfae2b-e66f-4860-840b-5f51b6c2fa9b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1093 microversion: 2.1 time: 0.122819 Jun 23 22:47:09.898143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 142/281] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:09 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1093 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:10.009632 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8dc399e3-9136-4ce5-ab02-b95da921693a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:10.019365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8dc399e3-9136-4ce5-ab02-b95da921693a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.230501 Jun 23 22:47:10.019365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 140/282] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:09 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:10.147795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ccdaa8d2-1b3d-47b9-a4aa-266e354c41a5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:10.148290 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ccdaa8d2-1b3d-47b9-a4aa-266e354c41a5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:10.150116 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:10.154781 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccdaa8d2-1b3d-47b9-a4aa-266e354c41a5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:10.155171 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccdaa8d2-1b3d-47b9-a4aa-266e354c41a5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:10.162697 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccdaa8d2-1b3d-47b9-a4aa-266e354c41a5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:10.162697 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccdaa8d2-1b3d-47b9-a4aa-266e354c41a5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:10.179690 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ccdaa8d2-1b3d-47b9-a4aa-266e354c41a5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.035822 Jun 23 22:47:10.180560 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 143/283] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:47:10 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:10.919454 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5ecf494e-4e9e-44e2-a50e-e1d3dd4bc4e6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:10.920051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5ecf494e-4e9e-44e2-a50e-e1d3dd4bc4e6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:10.991942 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5ecf494e-4e9e-44e2-a50e-e1d3dd4bc4e6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:10.998969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5ecf494e-4e9e-44e2-a50e-e1d3dd4bc4e6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1093 microversion: 2.1 time: 0.083565 Jun 23 22:47:11.004640 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 141/284] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:10 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:11.036510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-144a3424-cac8-4f63-8caf-7a368ef840b6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:11.037524 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-144a3424-cac8-4f63-8caf-7a368ef840b6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:11.045363 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-144a3424-cac8-4f63-8caf-7a368ef840b6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:11.045917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-144a3424-cac8-4f63-8caf-7a368ef840b6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:11.046750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-144a3424-cac8-4f63-8caf-7a368ef840b6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:11.047307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-144a3424-cac8-4f63-8caf-7a368ef840b6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:11.189388 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-144a3424-cac8-4f63-8caf-7a368ef840b6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:11.198892 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-144a3424-cac8-4f63-8caf-7a368ef840b6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.167381 Jun 23 22:47:11.199534 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 144/285] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:11 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:12.015039 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c1722e3b-9b3b-409d-8d81-32718fcc4c43 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:12.015827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c1722e3b-9b3b-409d-8d81-32718fcc4c43 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:12.023201 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1722e3b-9b3b-409d-8d81-32718fcc4c43 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:12.023648 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1722e3b-9b3b-409d-8d81-32718fcc4c43 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:12.024401 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1722e3b-9b3b-409d-8d81-32718fcc4c43 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:12.024855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1722e3b-9b3b-409d-8d81-32718fcc4c43 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:12.089404 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c1722e3b-9b3b-409d-8d81-32718fcc4c43 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:12.097183 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c1722e3b-9b3b-409d-8d81-32718fcc4c43 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1191 microversion: 2.1 time: 0.085930 Jun 23 22:47:12.097785 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 142/286] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:12 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:12.217704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ba8951a0-8b69-47db-92b9-fac5e3e4cbe6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:12.218454 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ba8951a0-8b69-47db-92b9-fac5e3e4cbe6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:12.225837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba8951a0-8b69-47db-92b9-fac5e3e4cbe6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:12.226462 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba8951a0-8b69-47db-92b9-fac5e3e4cbe6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:12.227494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba8951a0-8b69-47db-92b9-fac5e3e4cbe6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:12.228047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba8951a0-8b69-47db-92b9-fac5e3e4cbe6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:12.379611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8b94ad32-6513-4f8f-ade3-b04cc510cc06 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92ce0f73-e10b-4f18-9997-9511d87d2b34"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:12.380972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8b94ad32-6513-4f8f-ade3-b04cc510cc06 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:12.387095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ba8951a0-8b69-47db-92b9-fac5e3e4cbe6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:12.388047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b94ad32-6513-4f8f-ade3-b04cc510cc06 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:12.388492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b94ad32-6513-4f8f-ade3-b04cc510cc06 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:12.389296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b94ad32-6513-4f8f-ade3-b04cc510cc06 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:12.389731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b94ad32-6513-4f8f-ade3-b04cc510cc06 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:12.394862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ba8951a0-8b69-47db-92b9-fac5e3e4cbe6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.182371 Jun 23 22:47:12.395756 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 145/287] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:12 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:13.115984 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-991cf6d6-7eaf-48bf-a76f-7a2e0bb29b4b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:13.117584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-991cf6d6-7eaf-48bf-a76f-7a2e0bb29b4b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:13.125193 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-991cf6d6-7eaf-48bf-a76f-7a2e0bb29b4b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:13.125649 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-991cf6d6-7eaf-48bf-a76f-7a2e0bb29b4b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:13.126610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-991cf6d6-7eaf-48bf-a76f-7a2e0bb29b4b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:13.127213 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-991cf6d6-7eaf-48bf-a76f-7a2e0bb29b4b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:13.224688 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-991cf6d6-7eaf-48bf-a76f-7a2e0bb29b4b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:13.233378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-991cf6d6-7eaf-48bf-a76f-7a2e0bb29b4b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1209 microversion: 2.1 time: 0.122135 Jun 23 22:47:13.233971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 146/288] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:13 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:13.312726 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8b94ad32-6513-4f8f-ade3-b04cc510cc06 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936906 Jun 23 22:47:13.313386 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 143/289] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:47:12 2022] POST /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:13.411474 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-27d59b30-4fbb-4f36-b1dc-90340d8f341e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:13.412078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-27d59b30-4fbb-4f36-b1dc-90340d8f341e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:13.418352 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-27d59b30-4fbb-4f36-b1dc-90340d8f341e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:13.418800 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-27d59b30-4fbb-4f36-b1dc-90340d8f341e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:13.419571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-27d59b30-4fbb-4f36-b1dc-90340d8f341e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:13.419987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-27d59b30-4fbb-4f36-b1dc-90340d8f341e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:13.577325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-27d59b30-4fbb-4f36-b1dc-90340d8f341e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:13.585993 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-27d59b30-4fbb-4f36-b1dc-90340d8f341e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.178265 Jun 23 22:47:13.586567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 147/290] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:13 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:14.251713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-79c3378e-5789-41f4-814f-155ffb24832f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:14.252794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-79c3378e-5789-41f4-814f-155ffb24832f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:14.263591 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c3378e-5789-41f4-814f-155ffb24832f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:14.270612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c3378e-5789-41f4-814f-155ffb24832f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:14.270612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c3378e-5789-41f4-814f-155ffb24832f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:14.270612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-79c3378e-5789-41f4-814f-155ffb24832f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:14.381094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-689fcaa0-e5b4-48d8-8425-344b69a4e374 req-4c7094c0-f9d2-4b8f-b067-c7e54f7c7504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888abca9-182a-4b16-bca8-0d861635e4a8", "tag": "9f8c9881-9990-481d-add2-75dd48a6c858"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:14.390431 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-689fcaa0-e5b4-48d8-8425-344b69a4e374 req-4c7094c0-f9d2-4b8f-b067-c7e54f7c7504 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:14.391010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-689fcaa0-e5b4-48d8-8425-344b69a4e374 req-4c7094c0-f9d2-4b8f-b067-c7e54f7c7504 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:14.478504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-79c3378e-5789-41f4-814f-155ffb24832f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:14.494419 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-79c3378e-5789-41f4-814f-155ffb24832f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1277 microversion: 2.1 time: 0.246786 Jun 23 22:47:14.495111 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 144/291] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:14 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:14.558665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-689fcaa0-e5b4-48d8-8425-344b69a4e374 req-4c7094c0-f9d2-4b8f-b067-c7e54f7c7504 service nova] Creating event network-changed:9f8c9881-9990-481d-add2-75dd48a6c858 for instance 888abca9-182a-4b16-bca8-0d861635e4a8 on hv-cinder-81322 Jun 23 22:47:14.564033 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-689fcaa0-e5b4-48d8-8425-344b69a4e374 req-4c7094c0-f9d2-4b8f-b067-c7e54f7c7504 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186479 Jun 23 22:47:14.564871 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 148/292] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:47:14.603068 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6179a838-e1a5-4316-b7be-ed7039ad102d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:14.603754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6179a838-e1a5-4316-b7be-ed7039ad102d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:14.616491 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6179a838-e1a5-4316-b7be-ed7039ad102d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:14.617077 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6179a838-e1a5-4316-b7be-ed7039ad102d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:14.617861 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6179a838-e1a5-4316-b7be-ed7039ad102d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:14.618292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6179a838-e1a5-4316-b7be-ed7039ad102d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:14.803207 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6179a838-e1a5-4316-b7be-ed7039ad102d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:14.810935 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6179a838-e1a5-4316-b7be-ed7039ad102d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.212505 Jun 23 22:47:14.813660 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 145/293] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:14 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:15.512194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c30e4f26-cc38-4e9c-81c7-09184d477533 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:15.512911 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c30e4f26-cc38-4e9c-81c7-09184d477533 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:15.519353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c30e4f26-cc38-4e9c-81c7-09184d477533 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:15.519796 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c30e4f26-cc38-4e9c-81c7-09184d477533 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:15.520550 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c30e4f26-cc38-4e9c-81c7-09184d477533 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:15.521002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c30e4f26-cc38-4e9c-81c7-09184d477533 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:15.658236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c30e4f26-cc38-4e9c-81c7-09184d477533 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:15.666545 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c30e4f26-cc38-4e9c-81c7-09184d477533 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.158539 Jun 23 22:47:15.667162 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 149/294] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:15 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:15.828889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-52fd49fb-d8d8-46a0-ad21-24d2b9e23176 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:15.829489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-52fd49fb-d8d8-46a0-ad21-24d2b9e23176 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:15.831950 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:15.837997 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52fd49fb-d8d8-46a0-ad21-24d2b9e23176 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:15.838446 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52fd49fb-d8d8-46a0-ad21-24d2b9e23176 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:15.839213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52fd49fb-d8d8-46a0-ad21-24d2b9e23176 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:15.839644 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52fd49fb-d8d8-46a0-ad21-24d2b9e23176 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:15.859018 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:16.014890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-52fd49fb-d8d8-46a0-ad21-24d2b9e23176 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:16.023051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-52fd49fb-d8d8-46a0-ad21-24d2b9e23176 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.198085 Jun 23 22:47:16.023616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 146/295] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:15 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:16.684409 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-56907be7-3453-4f97-8158-8264e18d6dca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:16.684952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-56907be7-3453-4f97-8158-8264e18d6dca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:16.691181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-56907be7-3453-4f97-8158-8264e18d6dca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:16.691637 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-56907be7-3453-4f97-8158-8264e18d6dca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:16.692409 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-56907be7-3453-4f97-8158-8264e18d6dca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:16.692874 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-56907be7-3453-4f97-8158-8264e18d6dca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:16.825957 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-56907be7-3453-4f97-8158-8264e18d6dca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:16.833336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-56907be7-3453-4f97-8158-8264e18d6dca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.152915 Jun 23 22:47:16.833892 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 150/296] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:16 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:17.039542 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-efe89535-96dc-447d-8c9a-b44745ce315a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:17.040154 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-efe89535-96dc-447d-8c9a-b44745ce315a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:17.046866 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efe89535-96dc-447d-8c9a-b44745ce315a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:17.047318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efe89535-96dc-447d-8c9a-b44745ce315a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:17.048091 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efe89535-96dc-447d-8c9a-b44745ce315a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:17.048553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efe89535-96dc-447d-8c9a-b44745ce315a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:17.181115 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-efe89535-96dc-447d-8c9a-b44745ce315a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:17.188924 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-efe89535-96dc-447d-8c9a-b44745ce315a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.153627 Jun 23 22:47:17.189477 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 147/297] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:17 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:17.850587 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f73ed72a-9849-4ac4-9e1b-7c9dbe8fc54c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:17.851274 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f73ed72a-9849-4ac4-9e1b-7c9dbe8fc54c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:17.857338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f73ed72a-9849-4ac4-9e1b-7c9dbe8fc54c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:17.857796 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f73ed72a-9849-4ac4-9e1b-7c9dbe8fc54c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:17.858555 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f73ed72a-9849-4ac4-9e1b-7c9dbe8fc54c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:17.858996 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f73ed72a-9849-4ac4-9e1b-7c9dbe8fc54c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:17.994204 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f73ed72a-9849-4ac4-9e1b-7c9dbe8fc54c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:18.001578 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f73ed72a-9849-4ac4-9e1b-7c9dbe8fc54c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.155390 Jun 23 22:47:18.002130 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 151/298] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:17 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:18.206403 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bf2ebc58-54fd-4d22-b37c-1d7109d30247 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:18.206941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bf2ebc58-54fd-4d22-b37c-1d7109d30247 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:18.214468 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf2ebc58-54fd-4d22-b37c-1d7109d30247 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:18.214914 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf2ebc58-54fd-4d22-b37c-1d7109d30247 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:18.215666 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf2ebc58-54fd-4d22-b37c-1d7109d30247 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:18.216101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf2ebc58-54fd-4d22-b37c-1d7109d30247 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:18.347538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bf2ebc58-54fd-4d22-b37c-1d7109d30247 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:18.355647 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bf2ebc58-54fd-4d22-b37c-1d7109d30247 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.153229 Jun 23 22:47:18.356196 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 148/299] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:18 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:19.023556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ec8603a3-0e6c-4273-b1c3-308fd64dd5f6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:19.030917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ec8603a3-0e6c-4273-b1c3-308fd64dd5f6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:19.030917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec8603a3-0e6c-4273-b1c3-308fd64dd5f6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:19.030917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec8603a3-0e6c-4273-b1c3-308fd64dd5f6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:19.031588 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec8603a3-0e6c-4273-b1c3-308fd64dd5f6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:19.032030 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec8603a3-0e6c-4273-b1c3-308fd64dd5f6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:19.168483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ec8603a3-0e6c-4273-b1c3-308fd64dd5f6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:19.177106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ec8603a3-0e6c-4273-b1c3-308fd64dd5f6 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.157547 Jun 23 22:47:19.177687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 152/300] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:19 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:19.372934 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7f3ca7c8-215b-4909-a593-4d313750d146 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:19.373577 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7f3ca7c8-215b-4909-a593-4d313750d146 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:19.375998 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:19.381734 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f3ca7c8-215b-4909-a593-4d313750d146 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:19.388117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f3ca7c8-215b-4909-a593-4d313750d146 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:19.388117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f3ca7c8-215b-4909-a593-4d313750d146 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:19.388117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f3ca7c8-215b-4909-a593-4d313750d146 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:19.760648 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7f3ca7c8-215b-4909-a593-4d313750d146 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:19.769625 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7f3ca7c8-215b-4909-a593-4d313750d146 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.400747 Jun 23 22:47:19.770465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 149/301] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:19 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:20.194826 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fa1de7f6-b6c9-425b-b449-16def3eb58da tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:20.195618 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fa1de7f6-b6c9-425b-b449-16def3eb58da tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:20.198182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:20.203698 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fa1de7f6-b6c9-425b-b449-16def3eb58da tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:20.204370 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fa1de7f6-b6c9-425b-b449-16def3eb58da tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:20.205485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fa1de7f6-b6c9-425b-b449-16def3eb58da tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:20.205920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fa1de7f6-b6c9-425b-b449-16def3eb58da tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:20.364671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-fa1de7f6-b6c9-425b-b449-16def3eb58da tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:20.373389 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fa1de7f6-b6c9-425b-b449-16def3eb58da tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.182525 Jun 23 22:47:20.383630 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 153/302] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:20 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:20.787196 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-320b1511-f544-45fe-b1df-73e0be712f6e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:20.788476 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-320b1511-f544-45fe-b1df-73e0be712f6e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:20.800738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-320b1511-f544-45fe-b1df-73e0be712f6e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:20.800738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-320b1511-f544-45fe-b1df-73e0be712f6e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:20.800738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-320b1511-f544-45fe-b1df-73e0be712f6e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:20.800738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-320b1511-f544-45fe-b1df-73e0be712f6e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:20.934380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-320b1511-f544-45fe-b1df-73e0be712f6e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:20.942058 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-320b1511-f544-45fe-b1df-73e0be712f6e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.158831 Jun 23 22:47:20.942690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 150/303] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:20 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:21.391411 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a1623780-94a3-4a64-897a-387df7a3cb6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:21.392158 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a1623780-94a3-4a64-897a-387df7a3cb6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:21.399686 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1623780-94a3-4a64-897a-387df7a3cb6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:21.400164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1623780-94a3-4a64-897a-387df7a3cb6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:21.400967 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1623780-94a3-4a64-897a-387df7a3cb6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:21.401412 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1623780-94a3-4a64-897a-387df7a3cb6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:21.541504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a1623780-94a3-4a64-897a-387df7a3cb6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:21.552342 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a1623780-94a3-4a64-897a-387df7a3cb6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.162014 Jun 23 22:47:21.553065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 154/304] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:21 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:21.959083 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8566414f-43a8-4b63-946b-895ed3987c4b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:21.960317 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8566414f-43a8-4b63-946b-895ed3987c4b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:21.962160 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:21.967478 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8566414f-43a8-4b63-946b-895ed3987c4b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:21.967920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8566414f-43a8-4b63-946b-895ed3987c4b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:21.968697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8566414f-43a8-4b63-946b-895ed3987c4b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:21.969131 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8566414f-43a8-4b63-946b-895ed3987c4b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:22.102627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8566414f-43a8-4b63-946b-895ed3987c4b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:22.110297 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8566414f-43a8-4b63-946b-895ed3987c4b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.155107 Jun 23 22:47:22.110857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 151/305] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:21 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:22.569888 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-70c19448-4f1c-452a-81e7-c6a879c8e74b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:22.570533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-70c19448-4f1c-452a-81e7-c6a879c8e74b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:22.579197 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-70c19448-4f1c-452a-81e7-c6a879c8e74b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:22.580063 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-70c19448-4f1c-452a-81e7-c6a879c8e74b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:22.581504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-70c19448-4f1c-452a-81e7-c6a879c8e74b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:22.582567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-70c19448-4f1c-452a-81e7-c6a879c8e74b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:22.739052 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-70c19448-4f1c-452a-81e7-c6a879c8e74b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:22.747879 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-70c19448-4f1c-452a-81e7-c6a879c8e74b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.182584 Jun 23 22:47:22.748469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 155/306] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:22 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:23.127268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-44169633-e6ca-44b7-a737-c27cf8dce4cc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:23.128065 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-44169633-e6ca-44b7-a737-c27cf8dce4cc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:23.135033 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44169633-e6ca-44b7-a737-c27cf8dce4cc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:23.135484 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44169633-e6ca-44b7-a737-c27cf8dce4cc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:23.136250 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44169633-e6ca-44b7-a737-c27cf8dce4cc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:23.136714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44169633-e6ca-44b7-a737-c27cf8dce4cc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:23.279368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-44169633-e6ca-44b7-a737-c27cf8dce4cc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:23.286996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-44169633-e6ca-44b7-a737-c27cf8dce4cc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.163604 Jun 23 22:47:23.288464 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 152/307] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:23 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:23.465754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-26c445dc-680e-4772-81bb-899ea3b3ae36 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: .version_select at 0x7fbbca51b1f0>, body: {"keypair": {"name": "tempest-keypair-1683318110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJWydklYBEHV7husx7eWIMuQ4QiqJ7sDdxMMRXFzSXb1Jm3slJHzRe5tYtAfcaK1yRvOgLOwZPSwQ4JfvLGOyipiS5NnKjKmZWDZe/cHq8NLBksh1Y0tI+l68tw5jhTFw=="}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:23.481570 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-26c445dc-680e-4772-81bb-899ea3b3ae36 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:47:23.486038 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-26c445dc-680e-4772-81bb-899ea3b3ae36 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for user 1d7e431402f8433fb7565f69103485ce and project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:47:23.613448 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-26c445dc-680e-4772-81bb-899ea3b3ae36 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.151038 Jun 23 22:47:23.616036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 156/308] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:47:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:23.656140 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-42170cf6-721b-40d9-ac3a-76e294debf51 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:23.656834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-42170cf6-721b-40d9-ac3a-76e294debf51 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:23.663618 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42170cf6-721b-40d9-ac3a-76e294debf51 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:23.664076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42170cf6-721b-40d9-ac3a-76e294debf51 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:23.664947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42170cf6-721b-40d9-ac3a-76e294debf51 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:23.665355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42170cf6-721b-40d9-ac3a-76e294debf51 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:23.692072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-42170cf6-721b-40d9-ac3a-76e294debf51 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/ips" status: 200 len: 151 microversion: 2.20 time: 0.040021 Jun 23 22:47:23.692680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 153/309] 10.222.0.33 () {60 vars in 1288 bytes} [Thu Jun 23 22:47:23 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:47:23.766229 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3e2c080c-e902-4b05-822c-e6daff7915ca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:23.766840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3e2c080c-e902-4b05-822c-e6daff7915ca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:23.773977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e2c080c-e902-4b05-822c-e6daff7915ca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:23.774709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e2c080c-e902-4b05-822c-e6daff7915ca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:23.775666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e2c080c-e902-4b05-822c-e6daff7915ca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:23.776514 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e2c080c-e902-4b05-822c-e6daff7915ca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:23.934799 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3e2c080c-e902-4b05-822c-e6daff7915ca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:23.940878 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:23.943971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3e2c080c-e902-4b05-822c-e6daff7915ca tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.181114 Jun 23 22:47:23.953161 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 157/310] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:23 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:24.305223 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eda8bebb-ad1b-413a-9fe8-41bf562360a7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:24.306384 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-eda8bebb-ad1b-413a-9fe8-41bf562360a7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:24.314508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eda8bebb-ad1b-413a-9fe8-41bf562360a7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:24.314508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eda8bebb-ad1b-413a-9fe8-41bf562360a7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:24.315079 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eda8bebb-ad1b-413a-9fe8-41bf562360a7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:24.315627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eda8bebb-ad1b-413a-9fe8-41bf562360a7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:24.461942 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-eda8bebb-ad1b-413a-9fe8-41bf562360a7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:24.471492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-eda8bebb-ad1b-413a-9fe8-41bf562360a7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.170411 Jun 23 22:47:24.472296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 154/311] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:24 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:24.963923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-55d734bc-8dd9-4e31-b731-b4b305618ea3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:24.965321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-55d734bc-8dd9-4e31-b731-b4b305618ea3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:24.979717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-55d734bc-8dd9-4e31-b731-b4b305618ea3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:24.980733 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-55d734bc-8dd9-4e31-b731-b4b305618ea3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:24.982030 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-55d734bc-8dd9-4e31-b731-b4b305618ea3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:24.982983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-55d734bc-8dd9-4e31-b731-b4b305618ea3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:25.060695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-7394f733-01c1-4a05-bb72-d984fa2f3d6f req-8f76a4ff-0346-46c6-b22a-e2f3f56567c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888abca9-182a-4b16-bca8-0d861635e4a8", "name": "network-vif-plugged", "status": "completed", "tag": "9f8c9881-9990-481d-add2-75dd48a6c858"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:25.069302 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7394f733-01c1-4a05-bb72-d984fa2f3d6f req-8f76a4ff-0346-46c6-b22a-e2f3f56567c1 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:25.069765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7394f733-01c1-4a05-bb72-d984fa2f3d6f req-8f76a4ff-0346-46c6-b22a-e2f3f56567c1 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:25.081463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-7394f733-01c1-4a05-bb72-d984fa2f3d6f req-8f76a4ff-0346-46c6-b22a-e2f3f56567c1 service nova] Creating event network-vif-plugged:9f8c9881-9990-481d-add2-75dd48a6c858 for instance 888abca9-182a-4b16-bca8-0d861635e4a8 on hv-cinder-81322 Jun 23 22:47:25.087933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-7394f733-01c1-4a05-bb72-d984fa2f3d6f req-8f76a4ff-0346-46c6-b22a-e2f3f56567c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Jun 23 22:47:25.088346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 155/312] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:47:25.156715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-55d734bc-8dd9-4e31-b731-b4b305618ea3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:25.166289 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-55d734bc-8dd9-4e31-b731-b4b305618ea3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.208741 Jun 23 22:47:25.167125 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 158/313] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:24 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:25.490225 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2b5cfacc-9e80-4303-ac94-8eb7ea97bc05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:25.490974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2b5cfacc-9e80-4303-ac94-8eb7ea97bc05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:25.498317 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b5cfacc-9e80-4303-ac94-8eb7ea97bc05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:25.499064 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b5cfacc-9e80-4303-ac94-8eb7ea97bc05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:25.499914 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b5cfacc-9e80-4303-ac94-8eb7ea97bc05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:25.501430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b5cfacc-9e80-4303-ac94-8eb7ea97bc05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:25.776200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2b5cfacc-9e80-4303-ac94-8eb7ea97bc05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:25.783693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2b5cfacc-9e80-4303-ac94-8eb7ea97bc05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.297670 Jun 23 22:47:25.784251 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 156/314] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:25 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:26.059206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-86b4ece8-87db-4a11-a44b-508c23c0266b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:26.059752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-86b4ece8-87db-4a11-a44b-508c23c0266b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:26.067045 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86b4ece8-87db-4a11-a44b-508c23c0266b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:26.067797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86b4ece8-87db-4a11-a44b-508c23c0266b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:26.069668 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86b4ece8-87db-4a11-a44b-508c23c0266b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:26.070283 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86b4ece8-87db-4a11-a44b-508c23c0266b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:26.095816 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-86b4ece8-87db-4a11-a44b-508c23c0266b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lazy-loading 'flavor' on Instance uuid 286fefab-3729-4c09-a3be-0af864c6de65 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:47:26.184685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f8decca4-c3a7-45ad-86b8-bee183d17c6e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:26.185418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f8decca4-c3a7-45ad-86b8-bee183d17c6e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:26.194057 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8decca4-c3a7-45ad-86b8-bee183d17c6e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:26.196204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8decca4-c3a7-45ad-86b8-bee183d17c6e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:26.196204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8decca4-c3a7-45ad-86b8-bee183d17c6e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:26.196204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f8decca4-c3a7-45ad-86b8-bee183d17c6e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:26.387212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f8decca4-c3a7-45ad-86b8-bee183d17c6e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:26.394621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f8decca4-c3a7-45ad-86b8-bee183d17c6e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1265 microversion: 2.1 time: 0.214266 Jun 23 22:47:26.395171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 157/315] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:26 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:26.657735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-292343449", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c28b5ed-da0d-4ee9-8621-fe10ec1946bf"}], "security_groups": [{"name": "tempest-securitygroup--1869776661"}], "key_name": "tempest-keypair-1683318110", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:30.129843 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] validate_networks() for [('3c28b5ed-da0d-4ee9-8621-fe10ec1946bf', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:47:30.336391 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-86b4ece8-87db-4a11-a44b-508c23c0266b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/action" status: 202 len: 0 microversion: 2.20 time: 4.280750 Jun 23 22:47:30.338677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 159/316] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 23 22:47:26 2022] POST /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/action => generated 0 bytes in 4286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:47:30.347112 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-86751014-5b85-4672-8d9d-83d607d24a94 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:30.348033 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-86751014-5b85-4672-8d9d-83d607d24a94 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:30.356267 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86751014-5b85-4672-8d9d-83d607d24a94 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.356896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86751014-5b85-4672-8d9d-83d607d24a94 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.357887 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86751014-5b85-4672-8d9d-83d607d24a94 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.358421 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86751014-5b85-4672-8d9d-83d607d24a94 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.506126 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-86751014-5b85-4672-8d9d-83d607d24a94 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:30.515275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-86751014-5b85-4672-8d9d-83d607d24a94 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.174347 Jun 23 22:47:30.520448 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 160/317] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:30 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:30.520845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-84081932-9123-4568-a6e0-9fb6991625aa tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:30.521665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-84081932-9123-4568-a6e0-9fb6991625aa tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:30.527988 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-84081932-9123-4568-a6e0-9fb6991625aa tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.528510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-84081932-9123-4568-a6e0-9fb6991625aa tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.529457 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-84081932-9123-4568-a6e0-9fb6991625aa tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.530005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-84081932-9123-4568-a6e0-9fb6991625aa tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.565564 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:47:30.565981 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:47:30.566443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:47:30.566840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:47:30.567240 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:47:30.576598 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.577053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.578138 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.578568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.595856 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:47:30.600937 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for user 1d7e431402f8433fb7565f69103485ce and project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:47:30.613161 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:47:30.616199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:47:30.671635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-84081932-9123-4568-a6e0-9fb6991625aa tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:30.679990 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-84081932-9123-4568-a6e0-9fb6991625aa tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1453 microversion: 2.1 time: 0.162973 Jun 23 22:47:30.680669 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 161/318] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:30 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:30.685074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:30.689258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:30.691579 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.692367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.693250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.693784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.761505 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d45fc48c-7776-47b3-a569-8bcae78cb98a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.107836 Jun 23 22:47:30.762740 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 158/319] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:47:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 4110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 22:47:30.767745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1794cc92-bf2c-4bd3-bca4-ebbb9d7908a7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:30.768437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1794cc92-bf2c-4bd3-bca4-ebbb9d7908a7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:30.775872 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1794cc92-bf2c-4bd3-bca4-ebbb9d7908a7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.776561 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1794cc92-bf2c-4bd3-bca4-ebbb9d7908a7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.777360 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1794cc92-bf2c-4bd3-bca4-ebbb9d7908a7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:30.777836 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1794cc92-bf2c-4bd3-bca4-ebbb9d7908a7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:30.845380 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:30.859966 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:30.863231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:30.864510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a1ee2008-cf27-45a4-86fc-f85fc8bcf282 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.182838 Jun 23 22:47:30.865132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 162/320] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:30 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:30.888729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5d176108-f867-4100-97c9-7e7a05a97b18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:30.889338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5d176108-f867-4100-97c9-7e7a05a97b18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:30.944566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5d176108-f867-4100-97c9-7e7a05a97b18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:30.946097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1794cc92-bf2c-4bd3-bca4-ebbb9d7908a7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:30.952065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5d176108-f867-4100-97c9-7e7a05a97b18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1241 microversion: 2.1 time: 0.085007 Jun 23 22:47:30.952782 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 163/321] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:30 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:30.953813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1794cc92-bf2c-4bd3-bca4-ebbb9d7908a7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1453 microversion: 2.1 time: 0.189892 Jun 23 22:47:30.954365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 159/322] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:30 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1453 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:31.534287 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8ee7ac24-cd7f-4ac1-b0ee-b58074a5e5df tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:31.535073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8ee7ac24-cd7f-4ac1-b0ee-b58074a5e5df tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:31.541522 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ee7ac24-cd7f-4ac1-b0ee-b58074a5e5df tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:31.541902 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ee7ac24-cd7f-4ac1-b0ee-b58074a5e5df tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:31.542667 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ee7ac24-cd7f-4ac1-b0ee-b58074a5e5df tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:31.543101 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ee7ac24-cd7f-4ac1-b0ee-b58074a5e5df tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:31.673830 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8ee7ac24-cd7f-4ac1-b0ee-b58074a5e5df tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:31.683752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8ee7ac24-cd7f-4ac1-b0ee-b58074a5e5df tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.153782 Jun 23 22:47:31.684623 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 164/323] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:31 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:31.884078 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:31.885004 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:31.891941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:31.892394 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:31.893169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:31.893698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:31.972725 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b90ff7f5-ebb6-4400-9d23-e0849b21a721 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:31.973641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b90ff7f5-ebb6-4400-9d23-e0849b21a721 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:31.982406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b90ff7f5-ebb6-4400-9d23-e0849b21a721 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:31.983001 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b90ff7f5-ebb6-4400-9d23-e0849b21a721 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:31.983960 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b90ff7f5-ebb6-4400-9d23-e0849b21a721 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:31.984459 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b90ff7f5-ebb6-4400-9d23-e0849b21a721 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:32.063446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b90ff7f5-ebb6-4400-9d23-e0849b21a721 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:32.071440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b90ff7f5-ebb6-4400-9d23-e0849b21a721 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1245 microversion: 2.1 time: 0.106153 Jun 23 22:47:32.072004 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 165/324] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:31 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:32.226085 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:32.234279 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:32.235776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:32.236985 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e14b2a02-97ee-4a82-aefb-d56ae41afb7f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.357502 Jun 23 22:47:32.237601 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 160/325] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:31 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:32.701264 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fac688f8-0fe2-41de-a600-3498f00e1bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:32.702720 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fac688f8-0fe2-41de-a600-3498f00e1bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:32.712907 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fac688f8-0fe2-41de-a600-3498f00e1bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:32.712907 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fac688f8-0fe2-41de-a600-3498f00e1bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:32.712907 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fac688f8-0fe2-41de-a600-3498f00e1bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:32.712907 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fac688f8-0fe2-41de-a600-3498f00e1bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:32.850196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-fac688f8-0fe2-41de-a600-3498f00e1bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:32.858489 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fac688f8-0fe2-41de-a600-3498f00e1bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.161062 Jun 23 22:47:32.859070 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 166/326] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:32 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:33.090160 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4e39837b-0115-4043-8738-76de3224de9d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:33.091080 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4e39837b-0115-4043-8738-76de3224de9d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:33.098711 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e39837b-0115-4043-8738-76de3224de9d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.104857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e39837b-0115-4043-8738-76de3224de9d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:33.104857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e39837b-0115-4043-8738-76de3224de9d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.104857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4e39837b-0115-4043-8738-76de3224de9d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:33.198512 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4e39837b-0115-4043-8738-76de3224de9d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:33.206134 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4e39837b-0115-4043-8738-76de3224de9d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1293 microversion: 2.1 time: 0.121174 Jun 23 22:47:33.206695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 161/327] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:33 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1293 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:33.258158 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:33.258774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:33.265404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.265859 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:33.266846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.278771 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:33.416540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-1f3c1c40-98a5-4736-8a39-34881b775ac0 req-dc2d017f-fa29-4ef4-819e-986a0cc9b8ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "888abca9-182a-4b16-bca8-0d861635e4a8", "tag": "9f8c9881-9990-481d-add2-75dd48a6c858"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:33.424944 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-1f3c1c40-98a5-4736-8a39-34881b775ac0 req-dc2d017f-fa29-4ef4-819e-986a0cc9b8ab service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.425634 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-1f3c1c40-98a5-4736-8a39-34881b775ac0 req-dc2d017f-fa29-4ef4-819e-986a0cc9b8ab service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:33.438728 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-1f3c1c40-98a5-4736-8a39-34881b775ac0 req-dc2d017f-fa29-4ef4-819e-986a0cc9b8ab service nova] Creating event network-changed:9f8c9881-9990-481d-add2-75dd48a6c858 for instance 888abca9-182a-4b16-bca8-0d861635e4a8 on hv-cinder-81322 Jun 23 22:47:33.445120 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-1f3c1c40-98a5-4736-8a39-34881b775ac0 req-dc2d017f-fa29-4ef4-819e-986a0cc9b8ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032800 Jun 23 22:47:33.446509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 162/328] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:33.489691 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:33.501740 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:33.503519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:33.505274 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7e4a80a5-91b0-475c-9bbc-8586817b3116 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.251107 Jun 23 22:47:33.505274 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 167/329] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:33 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:33.876008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-66f1009b-9942-4de3-b18e-580745a221fd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:33.877196 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-66f1009b-9942-4de3-b18e-580745a221fd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:33.885056 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-66f1009b-9942-4de3-b18e-580745a221fd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.885369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-66f1009b-9942-4de3-b18e-580745a221fd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:33.886406 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-66f1009b-9942-4de3-b18e-580745a221fd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:33.887125 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-66f1009b-9942-4de3-b18e-580745a221fd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:34.145332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-66f1009b-9942-4de3-b18e-580745a221fd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:34.154263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-66f1009b-9942-4de3-b18e-580745a221fd tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.282490 Jun 23 22:47:34.154841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 163/330] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:33 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:34.223563 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fe1480e6-7e0c-4953-9fd4-baab48f2448a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:34.224367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fe1480e6-7e0c-4953-9fd4-baab48f2448a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:34.230823 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fe1480e6-7e0c-4953-9fd4-baab48f2448a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:34.231276 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fe1480e6-7e0c-4953-9fd4-baab48f2448a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:34.232038 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fe1480e6-7e0c-4953-9fd4-baab48f2448a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:34.232478 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fe1480e6-7e0c-4953-9fd4-baab48f2448a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:34.302530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-fe1480e6-7e0c-4953-9fd4-baab48f2448a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:34.312003 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fe1480e6-7e0c-4953-9fd4-baab48f2448a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1299 microversion: 2.1 time: 0.092814 Jun 23 22:47:34.312673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 168/331] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:34 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:34.523321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:34.524567 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:34.531403 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:34.532210 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:34.533177 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:34.533824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:34.668212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:34.676262 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:34.677826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:34.678979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e4c7aebd-fbaf-4cd5-a5c5-fa41ccfb03cd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.160115 Jun 23 22:47:34.679528 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 164/332] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:34 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:35.179371 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-68233e54-cca4-4482-997c-17349790f9e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:35.179937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-68233e54-cca4-4482-997c-17349790f9e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:35.186198 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-68233e54-cca4-4482-997c-17349790f9e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.186655 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-68233e54-cca4-4482-997c-17349790f9e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.187419 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-68233e54-cca4-4482-997c-17349790f9e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.187857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-68233e54-cca4-4482-997c-17349790f9e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.322473 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-68233e54-cca4-4482-997c-17349790f9e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.329794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-200cdbf0-40b5-4539-8670-4792547b1cf0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:35.331430 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-68233e54-cca4-4482-997c-17349790f9e7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.155982 Jun 23 22:47:35.332954 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 169/333] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:35 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:35.333500 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-200cdbf0-40b5-4539-8670-4792547b1cf0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:35.344667 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-200cdbf0-40b5-4539-8670-4792547b1cf0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.345121 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-200cdbf0-40b5-4539-8670-4792547b1cf0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.345971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-200cdbf0-40b5-4539-8670-4792547b1cf0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.346426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-200cdbf0-40b5-4539-8670-4792547b1cf0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.366674 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:35.409976 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-200cdbf0-40b5-4539-8670-4792547b1cf0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.418130 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-200cdbf0-40b5-4539-8670-4792547b1cf0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1299 microversion: 2.1 time: 0.092463 Jun 23 22:47:35.418690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 165/334] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:35 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:35.697098 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:35.697703 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:35.703629 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.704072 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.705068 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:35.705501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:35.887648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.895646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.897737 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:35.898910 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-205cbb71-0bc5-464a-b883-d8a8ea3c5c4d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.206375 Jun 23 22:47:35.899696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 170/335] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:35 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:36.350005 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7956535c-521f-4066-949b-ab22dbf9545a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:36.350792 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7956535c-521f-4066-949b-ab22dbf9545a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:36.357496 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7956535c-521f-4066-949b-ab22dbf9545a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.358017 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7956535c-521f-4066-949b-ab22dbf9545a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.358839 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7956535c-521f-4066-949b-ab22dbf9545a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.359342 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7956535c-521f-4066-949b-ab22dbf9545a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.436625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-61c420c7-db03-4879-baf0-6aa9403be550 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:36.437894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-61c420c7-db03-4879-baf0-6aa9403be550 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:36.445149 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-61c420c7-db03-4879-baf0-6aa9403be550 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.448238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-61c420c7-db03-4879-baf0-6aa9403be550 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.448238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-61c420c7-db03-4879-baf0-6aa9403be550 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.448238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-61c420c7-db03-4879-baf0-6aa9403be550 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.510496 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-61c420c7-db03-4879-baf0-6aa9403be550 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:36.520391 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-61c420c7-db03-4879-baf0-6aa9403be550 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1299 microversion: 2.1 time: 0.089410 Jun 23 22:47:36.520988 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 171/336] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:36 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:36.549202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7956535c-521f-4066-949b-ab22dbf9545a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:36.566654 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7956535c-521f-4066-949b-ab22dbf9545a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1500 microversion: 2.1 time: 0.220507 Jun 23 22:47:36.568677 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 166/337] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:36 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1500 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:36.584543 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68503858-97f6-4d10-914b-67cdf38a8889"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:36.586308 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:36.592399 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.592879 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.593633 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.594065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.623424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] HTTP exception thrown: Cannot 'attach_volume' instance 192d5777-a83f-473b-bc1d-6ae78bd7326c while it is in vm_state rescued Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Request method failure captured: Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: POST /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c/os-volume_attachments HTTP/1.1 Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 74 Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0Fxgf8_W6nHzji-QVv9jKiLp4rg6lH_y6-T4g881cdcaBRhykJO0GrB4dCqu9pFmtp2fywc254ujM1yS_W8gisUumxZqIVtBkou9tpTQgKGhiSBP4vuty0nKCS6oCe-_37EzZxMUls-mnqqoz3G_53dfhEX2AvYPxQ_-nmCoCt624 Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:47:36.626378 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_19ed20d55acb41fcb18006919476bf80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 675d117397da452faa5221af0906fb12 Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {"volumeAttachment": {"volumeId": "68503858-97f6-4d10-914b-67cdf38a8889"}} Jun 23 22:47:36.631806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Cannot 'attach_volume' instance 192d5777-a83f-473b-bc1d-6ae78bd7326c while it is in vm_state rescued Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'server_id': '192d5777-a83f-473b-bc1d-6ae78bd7326c', 'body': {'volumeAttachment': {'volumeId': '68503858-97f6-4d10-914b-67cdf38a8889'}}} Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 192d5777-a83f-473b-bc1d-6ae78bd7326c in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:47:36.632548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 192d5777-a83f-473b-bc1d-6ae78bd7326c while it is in vm_state rescued Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:47:36.633754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:47:36.634897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:47:36.634897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:47:36.634897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 192d5777-a83f-473b-bc1d-6ae78bd7326c while it is in vm_state rescued Jun 23 22:47:36.634897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:47:36.634897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Returning 409 to user: Cannot 'attach_volume' instance 192d5777-a83f-473b-bc1d-6ae78bd7326c while it is in vm_state rescued {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:47:36.634897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8ab76ef8-3cce-4a68-8a3d-e69ce4b8519f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046175 Jun 23 22:47:36.634897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 172/338] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:47:36 2022] POST /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 23 22:47:36.636145 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6a0c8df5-389f-4303-8968-dc36b0d37ed3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:36.636709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6a0c8df5-389f-4303-8968-dc36b0d37ed3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:36.643131 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a0c8df5-389f-4303-8968-dc36b0d37ed3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.644088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a0c8df5-389f-4303-8968-dc36b0d37ed3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.645275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a0c8df5-389f-4303-8968-dc36b0d37ed3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.645883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a0c8df5-389f-4303-8968-dc36b0d37ed3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.860560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6a0c8df5-389f-4303-8968-dc36b0d37ed3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c/action" status: 202 len: 0 microversion: 2.1 time: 0.227907 Jun 23 22:47:36.861283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 167/339] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:47:36 2022] POST /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 22:47:36.869798 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-510ac628-2db4-4ebb-b67c-8def7fffd35d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:36.870688 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-510ac628-2db4-4ebb-b67c-8def7fffd35d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:36.877097 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-510ac628-2db4-4ebb-b67c-8def7fffd35d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.877812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-510ac628-2db4-4ebb-b67c-8def7fffd35d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.878799 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-510ac628-2db4-4ebb-b67c-8def7fffd35d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.879456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-510ac628-2db4-4ebb-b67c-8def7fffd35d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.919216 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:36.920414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:36.929194 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.930076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:36.930867 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:36.931479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:37.023106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-510ac628-2db4-4ebb-b67c-8def7fffd35d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:37.027175 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:37.040006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-510ac628-2db4-4ebb-b67c-8def7fffd35d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1508 microversion: 2.1 time: 0.173836 Jun 23 22:47:37.041010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 173/340] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:36 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:37.215765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:37.223999 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:37.227153 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:37.228396 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ef0c2985-5c50-44ba-b6e8-93bf615fb7fb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.314710 Jun 23 22:47:37.229009 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 168/341] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:36 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:37.541123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c09aaf77-f7fb-49db-af0c-19f3cf7982b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:37.541738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c09aaf77-f7fb-49db-af0c-19f3cf7982b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:37.556403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c09aaf77-f7fb-49db-af0c-19f3cf7982b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:37.558272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c09aaf77-f7fb-49db-af0c-19f3cf7982b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:37.559476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c09aaf77-f7fb-49db-af0c-19f3cf7982b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:37.560085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c09aaf77-f7fb-49db-af0c-19f3cf7982b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:37.744930 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c09aaf77-f7fb-49db-af0c-19f3cf7982b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:37.754268 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c09aaf77-f7fb-49db-af0c-19f3cf7982b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.218837 Jun 23 22:47:37.758238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 174/342] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:37 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:37.898336 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-be158a02-6b73-45bf-90fd-6274a530cf21 req-c37a4187-0056-44f2-81f3-7a677becfbfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c92940-b145-488a-9b8d-8c500cec9f96", "tag": "94f7e1f5-be8a-4ca0-9aea-4b9afcae2d71"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:37.918970 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-be158a02-6b73-45bf-90fd-6274a530cf21 req-c37a4187-0056-44f2-81f3-7a677becfbfc service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:37.919415 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-be158a02-6b73-45bf-90fd-6274a530cf21 req-c37a4187-0056-44f2-81f3-7a677becfbfc service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:37.954387 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-be158a02-6b73-45bf-90fd-6274a530cf21 req-c37a4187-0056-44f2-81f3-7a677becfbfc service nova] Creating event network-changed:94f7e1f5-be8a-4ca0-9aea-4b9afcae2d71 for instance 63c92940-b145-488a-9b8d-8c500cec9f96 on hv-cinder-81322 Jun 23 22:47:37.967721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-be158a02-6b73-45bf-90fd-6274a530cf21 req-c37a4187-0056-44f2-81f3-7a677becfbfc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077327 Jun 23 22:47:37.968816 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 169/343] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:38.058369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-05a288c4-79ab-4066-a966-c234ee382a26 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:38.059120 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-05a288c4-79ab-4066-a966-c234ee382a26 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:38.065602 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05a288c4-79ab-4066-a966-c234ee382a26 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:38.066380 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05a288c4-79ab-4066-a966-c234ee382a26 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:38.067395 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05a288c4-79ab-4066-a966-c234ee382a26 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:38.068063 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05a288c4-79ab-4066-a966-c234ee382a26 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:38.223512 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-05a288c4-79ab-4066-a966-c234ee382a26 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:38.231986 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-05a288c4-79ab-4066-a966-c234ee382a26 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1508 microversion: 2.1 time: 0.178705 Jun 23 22:47:38.232566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 175/344] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:38 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:38.248524 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:38.249237 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:38.255703 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:38.256230 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:38.257171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:38.257674 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:38.458438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:38.470653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:38.472159 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:38.473350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6254e730-80a9-4311-8630-ee3f85a579e7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.229289 Jun 23 22:47:38.473895 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 170/345] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:38 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:38.771847 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-55eba6fa-6752-4b14-a238-7c09f0194dd6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:38.773197 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-55eba6fa-6752-4b14-a238-7c09f0194dd6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:38.779651 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-55eba6fa-6752-4b14-a238-7c09f0194dd6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:38.780101 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-55eba6fa-6752-4b14-a238-7c09f0194dd6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:38.781005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-55eba6fa-6752-4b14-a238-7c09f0194dd6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:38.781598 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-55eba6fa-6752-4b14-a238-7c09f0194dd6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:38.918585 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-55eba6fa-6752-4b14-a238-7c09f0194dd6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:38.926162 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-55eba6fa-6752-4b14-a238-7c09f0194dd6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.158580 Jun 23 22:47:38.926723 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 176/346] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:38 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:39.249932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a8c4a959-d876-46de-aabe-6c5a5222ead3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:39.250532 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a8c4a959-d876-46de-aabe-6c5a5222ead3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:39.257772 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8c4a959-d876-46de-aabe-6c5a5222ead3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.258211 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8c4a959-d876-46de-aabe-6c5a5222ead3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.258960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8c4a959-d876-46de-aabe-6c5a5222ead3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.259385 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8c4a959-d876-46de-aabe-6c5a5222ead3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.395653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a8c4a959-d876-46de-aabe-6c5a5222ead3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:39.404023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a8c4a959-d876-46de-aabe-6c5a5222ead3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1508 microversion: 2.1 time: 0.157971 Jun 23 22:47:39.404769 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 171/347] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:39 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:39.501515 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:39.502117 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:39.508533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.509155 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.510002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.510551 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.646202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:39.654853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:39.656350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:39.661750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f2c89a2c-bfae-4a2c-a12d-dc77bbfa0e41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.159971 Jun 23 22:47:39.661750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 177/348] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:39 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:39.943206 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8b2aef49-deea-453e-86aa-4769f29d55c3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:39.943861 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8b2aef49-deea-453e-86aa-4769f29d55c3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:39.950166 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b2aef49-deea-453e-86aa-4769f29d55c3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.950612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b2aef49-deea-453e-86aa-4769f29d55c3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:39.951369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b2aef49-deea-453e-86aa-4769f29d55c3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:39.951801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8b2aef49-deea-453e-86aa-4769f29d55c3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:40.090374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8b2aef49-deea-453e-86aa-4769f29d55c3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:40.099576 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8b2aef49-deea-453e-86aa-4769f29d55c3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.160079 Jun 23 22:47:40.108928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 172/349] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:39 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:40.420975 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-02a3af5b-bb5a-48a8-8f0d-f7640d489b49 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:40.421513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-02a3af5b-bb5a-48a8-8f0d-f7640d489b49 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:40.430307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-02a3af5b-bb5a-48a8-8f0d-f7640d489b49 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:40.430307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-02a3af5b-bb5a-48a8-8f0d-f7640d489b49 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:40.430307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-02a3af5b-bb5a-48a8-8f0d-f7640d489b49 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:40.430307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-02a3af5b-bb5a-48a8-8f0d-f7640d489b49 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:40.567677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-02a3af5b-bb5a-48a8-8f0d-f7640d489b49 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:40.575931 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-02a3af5b-bb5a-48a8-8f0d-f7640d489b49 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1508 microversion: 2.1 time: 0.159013 Jun 23 22:47:40.576488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 178/350] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:40 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:40.676429 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:40.677055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:40.680164 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:40.680880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:40.685813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:40.686259 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:40.687068 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:40.687545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:40.829071 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:40.839109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:40.840974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:40.842856 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-68727ae9-e835-4814-b16a-66d83d51f163 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.169876 Jun 23 22:47:40.843738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 173/351] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:40 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:41.124408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3c5e5009-30b6-47b7-b9bf-b7dc5cdaa16d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:41.125052 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3c5e5009-30b6-47b7-b9bf-b7dc5cdaa16d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:41.126902 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:41.132546 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3c5e5009-30b6-47b7-b9bf-b7dc5cdaa16d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:41.133031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3c5e5009-30b6-47b7-b9bf-b7dc5cdaa16d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:41.133834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3c5e5009-30b6-47b7-b9bf-b7dc5cdaa16d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:41.134274 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3c5e5009-30b6-47b7-b9bf-b7dc5cdaa16d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:41.276844 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3c5e5009-30b6-47b7-b9bf-b7dc5cdaa16d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:41.284352 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3c5e5009-30b6-47b7-b9bf-b7dc5cdaa16d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.163975 Jun 23 22:47:41.284951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 179/352] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:41 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:41.593045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5054221d-bac1-463b-9f08-648fd1432f42 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:41.593649 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5054221d-bac1-463b-9f08-648fd1432f42 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:41.600988 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5054221d-bac1-463b-9f08-648fd1432f42 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:41.601421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5054221d-bac1-463b-9f08-648fd1432f42 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:41.602234 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5054221d-bac1-463b-9f08-648fd1432f42 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:41.603853 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5054221d-bac1-463b-9f08-648fd1432f42 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:41.737449 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5054221d-bac1-463b-9f08-648fd1432f42 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:41.745696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5054221d-bac1-463b-9f08-648fd1432f42 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1508 microversion: 2.1 time: 0.156832 Jun 23 22:47:41.757944 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 174/353] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:41 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:41.861742 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:41.862961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:41.870102 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:41.870589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:41.871518 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:41.871951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:42.022537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:42.031036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:42.032641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:42.033758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-128a112d-20d3-4583-8753-be0880d7b1d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.176202 Jun 23 22:47:42.034358 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 180/354] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:41 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:47:42.062450 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e4bda8b8-43dc-4a2c-8a0c-b8c3aa477b3d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7caa8da9-60a0-4c53-bcf8-277104d55200", "device": "/dev/sdb"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:42.064115 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e4bda8b8-43dc-4a2c-8a0c-b8c3aa477b3d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:42.071123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4bda8b8-43dc-4a2c-8a0c-b8c3aa477b3d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:42.071567 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4bda8b8-43dc-4a2c-8a0c-b8c3aa477b3d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:42.072321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4bda8b8-43dc-4a2c-8a0c-b8c3aa477b3d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:42.072778 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4bda8b8-43dc-4a2c-8a0c-b8c3aa477b3d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:42.303877 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-75c0b93d-95e4-4b02-8daa-e3f434c6a574 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:42.304801 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-75c0b93d-95e4-4b02-8daa-e3f434c6a574 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:42.306648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:42.311382 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75c0b93d-95e4-4b02-8daa-e3f434c6a574 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:42.311838 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75c0b93d-95e4-4b02-8daa-e3f434c6a574 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:42.312612 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75c0b93d-95e4-4b02-8daa-e3f434c6a574 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:42.313052 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75c0b93d-95e4-4b02-8daa-e3f434c6a574 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:42.464563 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-75c0b93d-95e4-4b02-8daa-e3f434c6a574 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:42.472321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-75c0b93d-95e4-4b02-8daa-e3f434c6a574 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.173270 Jun 23 22:47:42.472910 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 181/355] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:42 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:42.763766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8f473fab-9885-463d-b147-e30cd6e1d30a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:42.764377 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8f473fab-9885-463d-b147-e30cd6e1d30a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:42.771312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8f473fab-9885-463d-b147-e30cd6e1d30a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:42.772144 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8f473fab-9885-463d-b147-e30cd6e1d30a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:42.772949 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8f473fab-9885-463d-b147-e30cd6e1d30a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:42.773583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8f473fab-9885-463d-b147-e30cd6e1d30a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:42.925022 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8f473fab-9885-463d-b147-e30cd6e1d30a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:42.934542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8f473fab-9885-463d-b147-e30cd6e1d30a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1514 microversion: 2.1 time: 0.175200 Jun 23 22:47:42.935113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 182/356] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:42 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:43.058880 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:43.060799 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:43.070166 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:43.070905 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:43.071876 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:43.072315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:43.262072 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:43.281639 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:43.283498 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:43.284735 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d053790a-5658-43e8-bdc2-3885992b8690 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.231124 Jun 23 22:47:43.295996 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 183/357] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:43 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:47:43.492345 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a5bf224b-a300-498e-9772-d7a8ddf925e4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:43.493218 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a5bf224b-a300-498e-9772-d7a8ddf925e4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:43.502621 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a5bf224b-a300-498e-9772-d7a8ddf925e4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:43.503369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a5bf224b-a300-498e-9772-d7a8ddf925e4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:43.504707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a5bf224b-a300-498e-9772-d7a8ddf925e4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:43.505440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a5bf224b-a300-498e-9772-d7a8ddf925e4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:43.692548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a5bf224b-a300-498e-9772-d7a8ddf925e4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:43.713670 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a5bf224b-a300-498e-9772-d7a8ddf925e4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.227613 Jun 23 22:47:43.723511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 184/358] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:43 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:44.304216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:44.305593 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:44.312481 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.313037 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.313856 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.314295 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.398804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e4bda8b8-43dc-4a2c-8a0c-b8c3aa477b3d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "POST /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.339638 Jun 23 22:47:44.400706 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 175/359] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:47:42 2022] POST /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e/os-volume_attachments => generated 194 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:44.463430 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:44.471983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:44.473703 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:44.475666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4ffe441e-3faa-46ae-af90-fadabc4fe1a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.175602 Jun 23 22:47:44.484842 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 185/360] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:44 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:47:44.732347 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5fb61012-0882-4e12-a16d-71f445a41c0b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:44.733537 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5fb61012-0882-4e12-a16d-71f445a41c0b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:44.741365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fb61012-0882-4e12-a16d-71f445a41c0b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.741859 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fb61012-0882-4e12-a16d-71f445a41c0b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.742925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fb61012-0882-4e12-a16d-71f445a41c0b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:44.743358 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fb61012-0882-4e12-a16d-71f445a41c0b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:44.878100 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5fb61012-0882-4e12-a16d-71f445a41c0b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:44.886409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5fb61012-0882-4e12-a16d-71f445a41c0b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.159321 Jun 23 22:47:44.887266 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 176/361] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:44 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:44.921511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2289c5fe-ee38-4c65-8295-ad753eced22b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'create', calling method: .version_select at 0x7fbbca4b5670>, body: {"keypair": {"name": "tempest-keypair-1107818852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4RkEPEI7gB3dkNUe1S11hzxuDJEFPK+m1FNE1EdO68KxmrZ3pGiqgVNaACApIAlQekf0dzKrtE4kATWn63ZAWr1Aq0KrlQit/lmH0CVtX7t/N2oPnvGGWRrrKfdESF/A=="}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:44.938518 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-2289c5fe-ee38-4c65-8295-ad753eced22b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Getting quotas for project 19ed20d55acb41fcb18006919476bf80. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:47:44.944796 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-2289c5fe-ee38-4c65-8295-ad753eced22b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Getting quotas for user 675d117397da452faa5221af0906fb12 and project 19ed20d55acb41fcb18006919476bf80. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:47:45.023604 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2289c5fe-ee38-4c65-8295-ad753eced22b tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106079 Jun 23 22:47:45.024200 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 186/362] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:47:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:45.495610 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:45.496212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:45.502348 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:45.503087 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:45.505221 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:45.505749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:45.660994 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:45.672707 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:45.674469 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:45.675873 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-686061cf-846b-4cd5-ba1d-93d14e2c446f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.185988 Jun 23 22:47:45.680608 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 177/363] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:45 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:45.903669 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-09a639bd-9f8d-4e98-b353-5f304ba9142b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:45.904286 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-09a639bd-9f8d-4e98-b353-5f304ba9142b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:45.910468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-09a639bd-9f8d-4e98-b353-5f304ba9142b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:45.910921 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-09a639bd-9f8d-4e98-b353-5f304ba9142b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:45.911676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-09a639bd-9f8d-4e98-b353-5f304ba9142b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:45.912776 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-09a639bd-9f8d-4e98-b353-5f304ba9142b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:46.046445 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-09a639bd-9f8d-4e98-b353-5f304ba9142b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:46.053993 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-09a639bd-9f8d-4e98-b353-5f304ba9142b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.154322 Jun 23 22:47:46.054548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 187/364] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:45 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:46.695455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:46.696699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:46.700461 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:46.704024 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:46.704539 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:46.705428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:46.705924 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:47.071424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-47cc1a5e-f2c9-49f5-89c5-2861f21bee22 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:47.072010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-47cc1a5e-f2c9-49f5-89c5-2861f21bee22 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:47.078194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47cc1a5e-f2c9-49f5-89c5-2861f21bee22 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:47.078642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47cc1a5e-f2c9-49f5-89c5-2861f21bee22 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:47.079407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47cc1a5e-f2c9-49f5-89c5-2861f21bee22 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:47.079844 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47cc1a5e-f2c9-49f5-89c5-2861f21bee22 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:47.118780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:47.126874 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:47.128500 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:47.129689 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-01213eef-ede7-4fd6-a408-2e24e71a8ca3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.438850 Jun 23 22:47:47.130458 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 178/365] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:46 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:47.209670 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-47cc1a5e-f2c9-49f5-89c5-2861f21bee22 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:47.217278 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-47cc1a5e-f2c9-49f5-89c5-2861f21bee22 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.150129 Jun 23 22:47:47.217844 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 188/366] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:47 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:47.462409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2030366534", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1602f0df-e0bd-4528-bb35-867b37bcef4f"}], "security_groups": [{"name": "tempest-securitygroup--529447216"}], "key_name": "tempest-keypair-1107818852", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:47.559685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] validate_networks() for [('1602f0df-e0bd-4528-bb35-867b37bcef4f', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:47:47.926589 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:47:47.927167 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:47:47.927409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:47:47.927907 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:47:47.928314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:47:47.937106 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:47.937549 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:47.938373 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:47.938803 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:47.955636 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Getting quotas for project 19ed20d55acb41fcb18006919476bf80. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:47:47.960185 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Getting quotas for user 675d117397da452faa5221af0906fb12 and project 19ed20d55acb41fcb18006919476bf80. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:47:47.970957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:47:47.973223 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:47:48.086404 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8eddcfe4-76e3-4f57-be7c-36966eda0f3c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.628947 Jun 23 22:47:48.087222 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 179/367] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:47:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:47:48.097871 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-daa09230-ed14-40e0-8302-bf72d6ad1a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:48.098485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-daa09230-ed14-40e0-8302-bf72d6ad1a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:48.148851 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:48.149798 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:48.159448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:48.160009 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:48.161157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:48.162150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:48.170910 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-daa09230-ed14-40e0-8302-bf72d6ad1a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:48.180602 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-daa09230-ed14-40e0-8302-bf72d6ad1a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1246 microversion: 2.1 time: 0.085698 Jun 23 22:47:48.190873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 189/368] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:48 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:48.234576 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0f2f7f74-a149-4d30-a0e5-7df99e0fe4df tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:48.235268 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0f2f7f74-a149-4d30-a0e5-7df99e0fe4df tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:48.242126 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0f2f7f74-a149-4d30-a0e5-7df99e0fe4df tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:48.242832 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0f2f7f74-a149-4d30-a0e5-7df99e0fe4df tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:48.243607 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0f2f7f74-a149-4d30-a0e5-7df99e0fe4df tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:48.244047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0f2f7f74-a149-4d30-a0e5-7df99e0fe4df tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:48.313225 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:48.324372 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:48.325933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:48.327276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-80b60ec1-93e4-4679-b76d-d1170ef9208a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.183931 Jun 23 22:47:48.327969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 180/369] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:48 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:47:48.421741 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0f2f7f74-a149-4d30-a0e5-7df99e0fe4df tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:48.429318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0f2f7f74-a149-4d30-a0e5-7df99e0fe4df tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.198740 Jun 23 22:47:48.429872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 190/370] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:48 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:49.198076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9765aa07-4b9b-4511-97b0-bf461c969902 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:49.198685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9765aa07-4b9b-4511-97b0-bf461c969902 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:49.205265 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9765aa07-4b9b-4511-97b0-bf461c969902 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:49.205713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9765aa07-4b9b-4511-97b0-bf461c969902 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:49.206465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9765aa07-4b9b-4511-97b0-bf461c969902 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:49.206898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9765aa07-4b9b-4511-97b0-bf461c969902 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:49.211730 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:49.271161 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9765aa07-4b9b-4511-97b0-bf461c969902 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:49.279380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9765aa07-4b9b-4511-97b0-bf461c969902 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1242 microversion: 2.1 time: 0.085191 Jun 23 22:47:49.279940 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 181/371] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:49 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:49.346434 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:49.346972 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:49.353324 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:49.353770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:49.354531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:49.354952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:49.446350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-49a2b15d-34da-4a33-b27e-017286d07a18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:49.446958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-49a2b15d-34da-4a33-b27e-017286d07a18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:49.457225 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-49a2b15d-34da-4a33-b27e-017286d07a18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:49.457668 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-49a2b15d-34da-4a33-b27e-017286d07a18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:49.458437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-49a2b15d-34da-4a33-b27e-017286d07a18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:49.459745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-49a2b15d-34da-4a33-b27e-017286d07a18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:49.494335 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:49.502886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:49.504380 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:49.506190 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ba6c0069-f464-402e-89a3-04e3afa7dd1a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.163319 Jun 23 22:47:49.507155 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 191/372] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:49 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:49.600001 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-49a2b15d-34da-4a33-b27e-017286d07a18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:49.609419 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-49a2b15d-34da-4a33-b27e-017286d07a18 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.167328 Jun 23 22:47:49.609972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 182/373] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:49 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:49.846424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-729c3cf8-2bfe-4557-a54d-6fa0dfaf920a req-ebb8f25c-cf36-4e5b-a01d-fab2ec43762d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c92940-b145-488a-9b8d-8c500cec9f96", "name": "network-vif-plugged", "status": "completed", "tag": "94f7e1f5-be8a-4ca0-9aea-4b9afcae2d71"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:49.855758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-729c3cf8-2bfe-4557-a54d-6fa0dfaf920a req-ebb8f25c-cf36-4e5b-a01d-fab2ec43762d service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:49.856122 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-729c3cf8-2bfe-4557-a54d-6fa0dfaf920a req-ebb8f25c-cf36-4e5b-a01d-fab2ec43762d service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:49.867372 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-729c3cf8-2bfe-4557-a54d-6fa0dfaf920a req-ebb8f25c-cf36-4e5b-a01d-fab2ec43762d service nova] Creating event network-vif-plugged:94f7e1f5-be8a-4ca0-9aea-4b9afcae2d71 for instance 63c92940-b145-488a-9b8d-8c500cec9f96 on hv-cinder-81322 Jun 23 22:47:49.872631 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-729c3cf8-2bfe-4557-a54d-6fa0dfaf920a req-ebb8f25c-cf36-4e5b-a01d-fab2ec43762d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030537 Jun 23 22:47:49.873260 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 192/374] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:50.296900 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5e532d22-4af8-4bf9-a8fc-2e654b5fd822 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:50.297508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5e532d22-4af8-4bf9-a8fc-2e654b5fd822 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:50.304675 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e532d22-4af8-4bf9-a8fc-2e654b5fd822 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:50.305127 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e532d22-4af8-4bf9-a8fc-2e654b5fd822 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:50.305893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e532d22-4af8-4bf9-a8fc-2e654b5fd822 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:50.306329 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e532d22-4af8-4bf9-a8fc-2e654b5fd822 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:50.396801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5e532d22-4af8-4bf9-a8fc-2e654b5fd822 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:50.404545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5e532d22-4af8-4bf9-a8fc-2e654b5fd822 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1316 microversion: 2.1 time: 0.111470 Jun 23 22:47:50.405157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 183/375] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:50 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1316 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:50.524407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:50.525564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:50.532513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:50.533146 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:50.533986 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:50.534491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:50.538959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:50.626852 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f9d0a65c-7a8b-4c73-adfc-86bab1d3aacd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:50.627456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f9d0a65c-7a8b-4c73-adfc-86bab1d3aacd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:50.638228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9d0a65c-7a8b-4c73-adfc-86bab1d3aacd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:50.638759 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9d0a65c-7a8b-4c73-adfc-86bab1d3aacd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:50.639985 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9d0a65c-7a8b-4c73-adfc-86bab1d3aacd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:50.640109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f9d0a65c-7a8b-4c73-adfc-86bab1d3aacd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:50.688748 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:50.698245 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:50.700036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:50.701404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ada7c2ab-4893-4ea5-a15c-12f5ae32911c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.181314 Jun 23 22:47:50.701717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 193/376] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:50 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:50.894604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f9d0a65c-7a8b-4c73-adfc-86bab1d3aacd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:50.904101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f9d0a65c-7a8b-4c73-adfc-86bab1d3aacd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.281127 Jun 23 22:47:50.905057 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 184/377] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:50 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:51.421636 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ecb17799-56a1-4759-968f-752d1b47143d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:51.422236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ecb17799-56a1-4759-968f-752d1b47143d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:51.428479 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ecb17799-56a1-4759-968f-752d1b47143d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:51.428960 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ecb17799-56a1-4759-968f-752d1b47143d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:51.429717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ecb17799-56a1-4759-968f-752d1b47143d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:51.430282 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ecb17799-56a1-4759-968f-752d1b47143d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:51.560946 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ecb17799-56a1-4759-968f-752d1b47143d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:51.569828 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ecb17799-56a1-4759-968f-752d1b47143d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.152034 Jun 23 22:47:51.570392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 194/378] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:51 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:51.719552 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:51.720157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:51.726697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:51.727145 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:51.727900 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:51.728325 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:51.857136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:51.865778 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:51.867292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:51.868801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0edcaece-e09e-4a6c-a662-2d4a83a2dfa6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.153025 Jun 23 22:47:51.869353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 185/379] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:51 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:47:51.923211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bc0d0790-4ab6-410a-bc0e-8e39b4a0faf4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:51.923850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-bc0d0790-4ab6-410a-bc0e-8e39b4a0faf4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:51.937432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bc0d0790-4ab6-410a-bc0e-8e39b4a0faf4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:51.937432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bc0d0790-4ab6-410a-bc0e-8e39b4a0faf4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:51.937432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bc0d0790-4ab6-410a-bc0e-8e39b4a0faf4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:51.937432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bc0d0790-4ab6-410a-bc0e-8e39b4a0faf4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:52.069916 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bc0d0790-4ab6-410a-bc0e-8e39b4a0faf4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:52.077698 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-bc0d0790-4ab6-410a-bc0e-8e39b4a0faf4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.158510 Jun 23 22:47:52.078341 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 195/380] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:51 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:52.588249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3646cb62-1d7f-4734-9c57-56ebfbc1a3e3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:52.588821 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3646cb62-1d7f-4734-9c57-56ebfbc1a3e3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:52.596498 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3646cb62-1d7f-4734-9c57-56ebfbc1a3e3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:52.597019 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3646cb62-1d7f-4734-9c57-56ebfbc1a3e3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:52.597784 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3646cb62-1d7f-4734-9c57-56ebfbc1a3e3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:52.598211 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3646cb62-1d7f-4734-9c57-56ebfbc1a3e3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:52.732705 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3646cb62-1d7f-4734-9c57-56ebfbc1a3e3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:52.740670 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3646cb62-1d7f-4734-9c57-56ebfbc1a3e3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.156284 Jun 23 22:47:52.741225 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 186/381] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:52 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:52.886837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:52.887359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:52.893395 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:52.893838 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:52.894583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:52.895012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:53.025006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:53.032965 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:53.034515 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:53.035673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-91552898-475e-4e59-b8b0-240b524a62a6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.152793 Jun 23 22:47:53.036229 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 196/382] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:52 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:53.095114 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dad6cb3c-9dbe-46e2-aec0-c94145fa2fee tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:53.095717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dad6cb3c-9dbe-46e2-aec0-c94145fa2fee tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:53.104692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dad6cb3c-9dbe-46e2-aec0-c94145fa2fee tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:53.104692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dad6cb3c-9dbe-46e2-aec0-c94145fa2fee tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:53.104692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dad6cb3c-9dbe-46e2-aec0-c94145fa2fee tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:53.105184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dad6cb3c-9dbe-46e2-aec0-c94145fa2fee tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:53.230244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dad6cb3c-9dbe-46e2-aec0-c94145fa2fee tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:53.237615 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dad6cb3c-9dbe-46e2-aec0-c94145fa2fee tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.146399 Jun 23 22:47:53.238168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 187/383] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:53 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:53.758123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d886ca8f-ba2e-45e3-a462-7d3c9cb9dbdb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:53.758737 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d886ca8f-ba2e-45e3-a462-7d3c9cb9dbdb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:53.764776 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d886ca8f-ba2e-45e3-a462-7d3c9cb9dbdb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:53.765224 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d886ca8f-ba2e-45e3-a462-7d3c9cb9dbdb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:53.765978 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d886ca8f-ba2e-45e3-a462-7d3c9cb9dbdb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:53.766413 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d886ca8f-ba2e-45e3-a462-7d3c9cb9dbdb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:53.889955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d886ca8f-ba2e-45e3-a462-7d3c9cb9dbdb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:53.898068 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d886ca8f-ba2e-45e3-a462-7d3c9cb9dbdb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.144385 Jun 23 22:47:53.898629 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 197/384] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:53 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:54.054635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:54.055254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:54.061753 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:54.062192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:54.062940 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:54.063369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:54.218536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:54.226782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:54.228278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:54.229473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7c3e7137-ebaa-44e6-a5f8-f50d52bfaadd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.179296 Jun 23 22:47:54.230051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 188/385] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:54 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:54.255963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8db93658-8275-459f-ba69-41c8f052cca7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:54.256592 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8db93658-8275-459f-ba69-41c8f052cca7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:54.262591 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8db93658-8275-459f-ba69-41c8f052cca7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:54.263046 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8db93658-8275-459f-ba69-41c8f052cca7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:54.263840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8db93658-8275-459f-ba69-41c8f052cca7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:54.264275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8db93658-8275-459f-ba69-41c8f052cca7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:54.409983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8db93658-8275-459f-ba69-41c8f052cca7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:54.419221 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8db93658-8275-459f-ba69-41c8f052cca7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1367 microversion: 2.1 time: 0.168010 Jun 23 22:47:54.420065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 198/386] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:54 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:54.915396 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d518a8a8-86f0-48ce-ad72-6d324f5a0ef4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:54.916296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d518a8a8-86f0-48ce-ad72-6d324f5a0ef4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:54.922494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d518a8a8-86f0-48ce-ad72-6d324f5a0ef4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:54.927031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d518a8a8-86f0-48ce-ad72-6d324f5a0ef4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:54.927031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d518a8a8-86f0-48ce-ad72-6d324f5a0ef4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:54.927031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d518a8a8-86f0-48ce-ad72-6d324f5a0ef4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:55.029914 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-c7901fc4-5acd-4439-a7a8-e84f43bf823c req-e88b0b18-3560-4f2d-b42f-a7356c7ec6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dafd3dc-6a6c-4a96-854d-e380a187a72b", "tag": "605d9a1c-2adc-425e-a04a-51601319bff5"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:55.046030 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-c7901fc4-5acd-4439-a7a8-e84f43bf823c req-e88b0b18-3560-4f2d-b42f-a7356c7ec6e5 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:55.046962 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-c7901fc4-5acd-4439-a7a8-e84f43bf823c req-e88b0b18-3560-4f2d-b42f-a7356c7ec6e5 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:55.076650 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-c7901fc4-5acd-4439-a7a8-e84f43bf823c req-e88b0b18-3560-4f2d-b42f-a7356c7ec6e5 service nova] Creating event network-changed:605d9a1c-2adc-425e-a04a-51601319bff5 for instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b on hv-cinder-81322 Jun 23 22:47:55.085103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-c7901fc4-5acd-4439-a7a8-e84f43bf823c req-e88b0b18-3560-4f2d-b42f-a7356c7ec6e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058911 Jun 23 22:47:55.086003 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 199/387] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:47:55.129181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d518a8a8-86f0-48ce-ad72-6d324f5a0ef4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:55.138191 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d518a8a8-86f0-48ce-ad72-6d324f5a0ef4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.227308 Jun 23 22:47:55.140467 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 189/388] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:54 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:55.250846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:55.251566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:55.259365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:55.259813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:55.260556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:55.262167 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:55.435570 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:55.439536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e917f19d-ba1a-42cf-a508-2cda17da908d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:55.439536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e917f19d-ba1a-42cf-a508-2cda17da908d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:55.444083 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e917f19d-ba1a-42cf-a508-2cda17da908d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:55.444535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e917f19d-ba1a-42cf-a508-2cda17da908d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:55.445215 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:55.445409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e917f19d-ba1a-42cf-a508-2cda17da908d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:55.445844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e917f19d-ba1a-42cf-a508-2cda17da908d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:55.446982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:55.448468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ef022624-3167-4251-92b0-2540a7b7b178 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.202854 Jun 23 22:47:55.449121 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 200/389] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:55 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:55.641003 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e917f19d-ba1a-42cf-a508-2cda17da908d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:55.650072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e917f19d-ba1a-42cf-a508-2cda17da908d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1557 microversion: 2.1 time: 0.216920 Jun 23 22:47:55.650893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 190/390] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:55 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:47:55.667262 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5d0d1706-6102-4828-9a6d-2f3d2965f570 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:55.667850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5d0d1706-6102-4828-9a6d-2f3d2965f570 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:55.674321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d0d1706-6102-4828-9a6d-2f3d2965f570 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:55.674877 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d0d1706-6102-4828-9a6d-2f3d2965f570 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:55.675709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d0d1706-6102-4828-9a6d-2f3d2965f570 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:55.676206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d0d1706-6102-4828-9a6d-2f3d2965f570 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:55.775437 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5d0d1706-6102-4828-9a6d-2f3d2965f570 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104720 Jun 23 22:47:55.775437 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 201/391] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 22:47:55 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:47:56.156847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-197133fc-5b02-48d8-ab0b-b2f02f12c931 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:56.157462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-197133fc-5b02-48d8-ab0b-b2f02f12c931 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:56.167061 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-197133fc-5b02-48d8-ab0b-b2f02f12c931 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:56.167536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-197133fc-5b02-48d8-ab0b-b2f02f12c931 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:56.169209 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-197133fc-5b02-48d8-ab0b-b2f02f12c931 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:56.169209 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-197133fc-5b02-48d8-ab0b-b2f02f12c931 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:56.318201 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-197133fc-5b02-48d8-ab0b-b2f02f12c931 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:56.325655 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-197133fc-5b02-48d8-ab0b-b2f02f12c931 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.172952 Jun 23 22:47:56.326216 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 191/392] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:56 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:56.473247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:56.473247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:56.479510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:56.480375 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:56.481844 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:56.482693 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:56.853776 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:56.862298 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:56.864402 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:56.866322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5c6904ab-a112-44de-bbd5-fb5226c6c1a1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.403198 Jun 23 22:47:56.867059 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 202/393] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:56 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:57.152247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-528214a3-3c17-4b52-878f-417c8f19bc38 req-51845713-0f4f-45a6-8eee-4cf980b8a73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63c92940-b145-488a-9b8d-8c500cec9f96", "tag": "94f7e1f5-be8a-4ca0-9aea-4b9afcae2d71"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:47:57.160665 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-528214a3-3c17-4b52-878f-417c8f19bc38 req-51845713-0f4f-45a6-8eee-4cf980b8a73e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:57.167316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-528214a3-3c17-4b52-878f-417c8f19bc38 req-51845713-0f4f-45a6-8eee-4cf980b8a73e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:57.172780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-528214a3-3c17-4b52-878f-417c8f19bc38 req-51845713-0f4f-45a6-8eee-4cf980b8a73e service nova] Creating event network-changed:94f7e1f5-be8a-4ca0-9aea-4b9afcae2d71 for instance 63c92940-b145-488a-9b8d-8c500cec9f96 on hv-cinder-81322 Jun 23 22:47:57.178853 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-528214a3-3c17-4b52-878f-417c8f19bc38 req-51845713-0f4f-45a6-8eee-4cf980b8a73e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030110 Jun 23 22:47:57.179442 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 192/394] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:47:57.343080 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-86f04f6a-16cb-47e2-b425-9567fde1996e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:57.343727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-86f04f6a-16cb-47e2-b425-9567fde1996e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:57.350140 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86f04f6a-16cb-47e2-b425-9567fde1996e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:57.350601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86f04f6a-16cb-47e2-b425-9567fde1996e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:57.351370 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86f04f6a-16cb-47e2-b425-9567fde1996e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:57.351811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86f04f6a-16cb-47e2-b425-9567fde1996e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:57.482806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-86f04f6a-16cb-47e2-b425-9567fde1996e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:57.490673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-86f04f6a-16cb-47e2-b425-9567fde1996e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.151434 Jun 23 22:47:57.491239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 203/395] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:57 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:57.885301 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:57.885979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:57.892683 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:57.893851 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:57.893991 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:57.894349 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:57.947000 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:57.966471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:58.037926 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:58.046406 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:58.048659 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:58.049363 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8c550416-eb52-4d2b-b8e3-d92927da7927 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.168591 Jun 23 22:47:58.049925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 193/396] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:57 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:58.508491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b0c42358-2a47-4702-b625-b7115ce365ff tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:58.509133 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b0c42358-2a47-4702-b625-b7115ce365ff tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:58.511207 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:47:58.516162 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b0c42358-2a47-4702-b625-b7115ce365ff tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:58.516694 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b0c42358-2a47-4702-b625-b7115ce365ff tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:58.517460 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b0c42358-2a47-4702-b625-b7115ce365ff tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:58.517901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b0c42358-2a47-4702-b625-b7115ce365ff tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:58.649979 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b0c42358-2a47-4702-b625-b7115ce365ff tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:58.657589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b0c42358-2a47-4702-b625-b7115ce365ff tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.153869 Jun 23 22:47:58.658151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 204/397] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:58 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:47:59.067900 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:59.068514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:59.075553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:59.075984 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:59.076780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:59.077212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:59.206942 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:59.214960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:59.216471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:59.217650 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d0504b27-8e53-4cb1-b508-23feaae32571 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.154120 Jun 23 22:47:59.218204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 194/398] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:47:59 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:47:59.674321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c089eee9-b909-41ad-aebb-5499a54cf9b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:47:59.674923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c089eee9-b909-41ad-aebb-5499a54cf9b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:47:59.681085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c089eee9-b909-41ad-aebb-5499a54cf9b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:59.681530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c089eee9-b909-41ad-aebb-5499a54cf9b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:59.682331 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c089eee9-b909-41ad-aebb-5499a54cf9b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:47:59.682761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c089eee9-b909-41ad-aebb-5499a54cf9b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:47:59.813311 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c089eee9-b909-41ad-aebb-5499a54cf9b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:47:59.821581 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c089eee9-b909-41ad-aebb-5499a54cf9b0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.151079 Jun 23 22:47:59.822154 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 205/399] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:47:59 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:00.236154 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:00.236790 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:00.244104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:00.244550 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:00.245405 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:00.245754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:00.407314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:00.416077 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:00.417635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:00.418791 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d9d5a4f5-259e-4f5b-bdf0-7391fe6ef24f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.186520 Jun 23 22:48:00.419341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 195/400] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:00 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:00.838455 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ef76c848-4c03-415c-a5a3-9f6d14d27e7a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:00.839074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ef76c848-4c03-415c-a5a3-9f6d14d27e7a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:00.845154 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef76c848-4c03-415c-a5a3-9f6d14d27e7a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:00.845605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef76c848-4c03-415c-a5a3-9f6d14d27e7a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:00.846363 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef76c848-4c03-415c-a5a3-9f6d14d27e7a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:00.846804 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef76c848-4c03-415c-a5a3-9f6d14d27e7a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:00.982340 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ef76c848-4c03-415c-a5a3-9f6d14d27e7a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:00.990504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ef76c848-4c03-415c-a5a3-9f6d14d27e7a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.156077 Jun 23 22:48:00.991169 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 206/401] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:00 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:01.437958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:01.438752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:01.448494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:01.448494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:01.449116 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:01.449719 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:01.587889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:01.595948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:01.597619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:01.598917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-62c4d20d-210c-4453-a3d9-af29da1c2009 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.164908 Jun 23 22:48:01.599736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 196/402] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:01 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:02.008340 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c39cd017-a75f-485c-9492-bda8446e8a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:02.009573 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c39cd017-a75f-485c-9492-bda8446e8a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:02.016078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c39cd017-a75f-485c-9492-bda8446e8a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:02.016532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c39cd017-a75f-485c-9492-bda8446e8a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:02.017580 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c39cd017-a75f-485c-9492-bda8446e8a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:02.018026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c39cd017-a75f-485c-9492-bda8446e8a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:02.181335 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c39cd017-a75f-485c-9492-bda8446e8a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:02.190276 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c39cd017-a75f-485c-9492-bda8446e8a6a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.186848 Jun 23 22:48:02.190996 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 207/403] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:02 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:02.618047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:02.619247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:02.626832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:02.627463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:02.628797 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:02.630489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:02.791765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:02.800017 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:02.802493 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:02.803271 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e911df8a-0274-444f-9b46-0c0ef925f022 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1744 microversion: 2.20 time: 0.190090 Jun 23 22:48:02.803832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 197/404] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:02 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1744 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:03.207251 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e006787c-a63b-4c0f-a888-cbfa22253533 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:03.208537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e006787c-a63b-4c0f-a888-cbfa22253533 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:03.215130 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e006787c-a63b-4c0f-a888-cbfa22253533 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:03.215605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e006787c-a63b-4c0f-a888-cbfa22253533 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:03.216424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e006787c-a63b-4c0f-a888-cbfa22253533 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:03.217169 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e006787c-a63b-4c0f-a888-cbfa22253533 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:03.351137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e006787c-a63b-4c0f-a888-cbfa22253533 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:03.358622 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e006787c-a63b-4c0f-a888-cbfa22253533 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.155261 Jun 23 22:48:03.359187 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 208/405] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:03 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:03.823811 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:03.824554 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:03.833129 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:03.834266 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:03.834647 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:03.835151 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:03.854509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:03.979688 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:03.987598 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:03.990041 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:03.991544 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-713bcdc9-b9da-4f25-aa15-e8405e8bf51d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1744 microversion: 2.20 time: 0.172078 Jun 23 22:48:03.992735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 198/406] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:03 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:04.376392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8c6ace79-5227-43cb-912a-dabe3f569fd7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:04.376982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8c6ace79-5227-43cb-912a-dabe3f569fd7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:04.383704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8c6ace79-5227-43cb-912a-dabe3f569fd7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:04.384186 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8c6ace79-5227-43cb-912a-dabe3f569fd7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:04.385007 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8c6ace79-5227-43cb-912a-dabe3f569fd7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:04.385446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8c6ace79-5227-43cb-912a-dabe3f569fd7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:04.516640 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8c6ace79-5227-43cb-912a-dabe3f569fd7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:04.525426 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8c6ace79-5227-43cb-912a-dabe3f569fd7 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.153032 Jun 23 22:48:04.526065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 209/407] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:04 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:05.010013 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:05.010620 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:05.017528 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:05.017972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:05.018760 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:05.019349 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:05.149205 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:05.157268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:05.158764 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:05.159907 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d4a391b6-cd3e-451a-a1a3-edddf9c35786 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1744 microversion: 2.20 time: 0.153965 Jun 23 22:48:05.160455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 199/408] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:05 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:05.541744 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0318994d-67cc-4250-aa9b-04a22b3fa457 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:05.542382 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0318994d-67cc-4250-aa9b-04a22b3fa457 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:05.548456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0318994d-67cc-4250-aa9b-04a22b3fa457 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:05.548939 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0318994d-67cc-4250-aa9b-04a22b3fa457 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:05.549753 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0318994d-67cc-4250-aa9b-04a22b3fa457 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:05.550194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0318994d-67cc-4250-aa9b-04a22b3fa457 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:05.679494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0318994d-67cc-4250-aa9b-04a22b3fa457 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:05.682886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:05.687349 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0318994d-67cc-4250-aa9b-04a22b3fa457 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.149346 Jun 23 22:48:05.687912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 210/409] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:05 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:06.178745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:06.179342 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:06.185825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:06.186268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:06.187015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:06.187439 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:06.320177 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:06.327977 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:06.329499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:06.330637 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-29efc3e8-36e3-4ffd-8409-dfcb18bffa4a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1744 microversion: 2.20 time: 0.156261 Jun 23 22:48:06.331184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 200/410] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:06 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:06.706246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-05b48275-38bf-49c9-b4c0-ea93f7aa001e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:06.706886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-05b48275-38bf-49c9-b4c0-ea93f7aa001e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:06.713237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05b48275-38bf-49c9-b4c0-ea93f7aa001e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:06.713830 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05b48275-38bf-49c9-b4c0-ea93f7aa001e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:06.714425 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05b48275-38bf-49c9-b4c0-ea93f7aa001e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:06.714973 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05b48275-38bf-49c9-b4c0-ea93f7aa001e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:06.845407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-05b48275-38bf-49c9-b4c0-ea93f7aa001e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:06.853503 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-05b48275-38bf-49c9-b4c0-ea93f7aa001e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.151485 Jun 23 22:48:06.854092 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 211/411] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:06 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:07.350739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:07.350739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:07.357013 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:07.357466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:07.358220 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:07.358652 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:07.489849 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:07.498343 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:07.499859 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:07.501075 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-55cc6159-40b3-408d-9c24-f0d01e071d24 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.155333 Jun 23 22:48:07.501627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 201/412] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:07 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:48:07.870973 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-657aca91-5168-4df1-869a-7b03dc435cf5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:07.871581 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-657aca91-5168-4df1-869a-7b03dc435cf5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:07.877532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-657aca91-5168-4df1-869a-7b03dc435cf5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:07.877980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-657aca91-5168-4df1-869a-7b03dc435cf5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:07.878736 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-657aca91-5168-4df1-869a-7b03dc435cf5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:07.879169 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-657aca91-5168-4df1-869a-7b03dc435cf5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:08.023133 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-657aca91-5168-4df1-869a-7b03dc435cf5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:08.032644 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-657aca91-5168-4df1-869a-7b03dc435cf5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.165280 Jun 23 22:48:08.034180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 212/413] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:07 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:08.521414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:08.525605 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:08.546818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:08.551047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:08.552084 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:08.552726 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:08.778893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:08.842277 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:08.842277 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:08.842277 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0754d2dd-d264-4510-a372-19e734d03c71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.280056 Jun 23 22:48:08.842747 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 202/414] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:08 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:09.050547 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f1e869a0-20d1-49ae-8a9f-69da93e27594 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:09.051304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f1e869a0-20d1-49ae-8a9f-69da93e27594 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:09.057750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f1e869a0-20d1-49ae-8a9f-69da93e27594 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:09.058528 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f1e869a0-20d1-49ae-8a9f-69da93e27594 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:09.059292 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f1e869a0-20d1-49ae-8a9f-69da93e27594 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:09.059724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f1e869a0-20d1-49ae-8a9f-69da93e27594 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:09.234345 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f1e869a0-20d1-49ae-8a9f-69da93e27594 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:09.242533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f1e869a0-20d1-49ae-8a9f-69da93e27594 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.195821 Jun 23 22:48:09.243098 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 213/415] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:09 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:09.873954 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:09.876728 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:09.897097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:09.897717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:09.898621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:09.899147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:10.049453 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:10.058302 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:10.060087 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:10.061311 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-143cfa44-6a09-45b3-8473-140d6cfaf217 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.216955 Jun 23 22:48:10.062355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 203/416] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:09 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:10.322727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5589ce1c-109c-4a9f-b652-e754a0e2b18d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:10.322727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5589ce1c-109c-4a9f-b652-e754a0e2b18d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:10.322727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5589ce1c-109c-4a9f-b652-e754a0e2b18d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:10.322727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5589ce1c-109c-4a9f-b652-e754a0e2b18d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:10.323554 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5589ce1c-109c-4a9f-b652-e754a0e2b18d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:10.323554 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5589ce1c-109c-4a9f-b652-e754a0e2b18d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:10.645230 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5589ce1c-109c-4a9f-b652-e754a0e2b18d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:10.654209 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5589ce1c-109c-4a9f-b652-e754a0e2b18d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.398602 Jun 23 22:48:10.654784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 214/417] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:10 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:11.079314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:11.080102 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:11.086939 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:11.089470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:11.089470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:11.089470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:11.228042 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:11.236899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:11.241074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:11.243188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-da67c447-be7b-480d-aca1-bcfee94456ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.167882 Jun 23 22:48:11.244142 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 204/418] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:11 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:11.671613 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-23e3b734-989e-4c5c-adb0-1f67ed2f1265 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:11.672314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-23e3b734-989e-4c5c-adb0-1f67ed2f1265 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:11.679625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23e3b734-989e-4c5c-adb0-1f67ed2f1265 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:11.680364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23e3b734-989e-4c5c-adb0-1f67ed2f1265 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:11.681323 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23e3b734-989e-4c5c-adb0-1f67ed2f1265 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:11.681958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23e3b734-989e-4c5c-adb0-1f67ed2f1265 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:11.731218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-7beffe2d-0245-48fb-9c68-52e4646cdca6 req-19ee65be-20e1-4618-8623-d8e3408fc3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286fefab-3729-4c09-a3be-0af864c6de65", "name": "network-vif-plugged", "status": "completed", "tag": "b2734dfe-80ab-464a-85a5-81204d7db18e"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:11.752497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7beffe2d-0245-48fb-9c68-52e4646cdca6 req-19ee65be-20e1-4618-8623-d8e3408fc3a4 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:11.755075 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-7beffe2d-0245-48fb-9c68-52e4646cdca6 req-19ee65be-20e1-4618-8623-d8e3408fc3a4 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:11.778621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-7beffe2d-0245-48fb-9c68-52e4646cdca6 req-19ee65be-20e1-4618-8623-d8e3408fc3a4 service nova] Creating event network-vif-plugged:b2734dfe-80ab-464a-85a5-81204d7db18e for instance 286fefab-3729-4c09-a3be-0af864c6de65 on hv-cinder-81322 Jun 23 22:48:11.785469 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-7beffe2d-0245-48fb-9c68-52e4646cdca6 req-19ee65be-20e1-4618-8623-d8e3408fc3a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061740 Jun 23 22:48:11.786316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 205/419] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:48:11.905291 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-23e3b734-989e-4c5c-adb0-1f67ed2f1265 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:11.918761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-23e3b734-989e-4c5c-adb0-1f67ed2f1265 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.251022 Jun 23 22:48:11.919148 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 215/420] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:11 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:12.262602 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:12.264736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:12.282890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:12.289454 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:12.290541 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:12.291149 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:12.468715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:12.478817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:12.480381 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:12.495355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fa7a37b5-9670-4670-86c8-023187616150 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.237305 Jun 23 22:48:12.495932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 206/421] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:12 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:12.935823 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b656e450-a0d8-4092-8162-47c25dabcebe tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:12.936434 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b656e450-a0d8-4092-8162-47c25dabcebe tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:12.947237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b656e450-a0d8-4092-8162-47c25dabcebe tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:12.949170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b656e450-a0d8-4092-8162-47c25dabcebe tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:12.949170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b656e450-a0d8-4092-8162-47c25dabcebe tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:12.949170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b656e450-a0d8-4092-8162-47c25dabcebe tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:13.138558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b656e450-a0d8-4092-8162-47c25dabcebe tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:13.147512 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b656e450-a0d8-4092-8162-47c25dabcebe tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.216037 Jun 23 22:48:13.151681 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 216/422] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:12 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:13.513633 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:13.514331 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:13.524492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:13.532276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:13.533393 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:13.533982 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:13.774916 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:13.806065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-d0845581-4e4b-4908-8c65-9abd7f4d64fe req-cc56ddb4-1306-4e3f-9306-ec308eee0e71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dafd3dc-6a6c-4a96-854d-e380a187a72b", "name": "network-vif-plugged", "status": "completed", "tag": "605d9a1c-2adc-425e-a04a-51601319bff5"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:13.807784 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:13.814882 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:13.815107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:13.817336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-d0845581-4e4b-4908-8c65-9abd7f4d64fe req-cc56ddb4-1306-4e3f-9306-ec308eee0e71 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:13.818450 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-d0845581-4e4b-4908-8c65-9abd7f4d64fe req-cc56ddb4-1306-4e3f-9306-ec308eee0e71 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:13.830844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ff2b79b1-514c-40be-80ea-01d6982112e2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.315654 Jun 23 22:48:13.831257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-d0845581-4e4b-4908-8c65-9abd7f4d64fe req-cc56ddb4-1306-4e3f-9306-ec308eee0e71 service nova] Creating event network-vif-plugged:605d9a1c-2adc-425e-a04a-51601319bff5 for instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b on hv-cinder-81322 Jun 23 22:48:13.831779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 207/423] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:13 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:13.843399 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-d0845581-4e4b-4908-8c65-9abd7f4d64fe req-cc56ddb4-1306-4e3f-9306-ec308eee0e71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041957 Jun 23 22:48:13.846119 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 217/424] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:48:14.168057 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9fee5dd0-16aa-4571-8b34-63c4f24555ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:14.169283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9fee5dd0-16aa-4571-8b34-63c4f24555ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:14.177858 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fee5dd0-16aa-4571-8b34-63c4f24555ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:14.178580 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fee5dd0-16aa-4571-8b34-63c4f24555ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:14.179451 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fee5dd0-16aa-4571-8b34-63c4f24555ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:14.179883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9fee5dd0-16aa-4571-8b34-63c4f24555ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:14.359080 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9fee5dd0-16aa-4571-8b34-63c4f24555ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:14.372692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9fee5dd0-16aa-4571-8b34-63c4f24555ab tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.210253 Jun 23 22:48:14.373379 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 208/425] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:14 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:14.853377 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:14.854738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:14.877978 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:14.879565 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:14.881504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:14.883657 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:15.127535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:15.147668 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:15.151333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:15.155913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f857e100-2125-4608-902a-475bf706d25f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.304187 Jun 23 22:48:15.155913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 218/426] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:14 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:15.390838 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5fc3daa8-527f-4ae0-af79-28aeb2ae5757 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:15.395063 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5fc3daa8-527f-4ae0-af79-28aeb2ae5757 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:15.412414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fc3daa8-527f-4ae0-af79-28aeb2ae5757 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:15.413197 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fc3daa8-527f-4ae0-af79-28aeb2ae5757 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:15.415496 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fc3daa8-527f-4ae0-af79-28aeb2ae5757 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:15.416795 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5fc3daa8-527f-4ae0-af79-28aeb2ae5757 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:15.659973 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5fc3daa8-527f-4ae0-af79-28aeb2ae5757 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:15.672054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5fc3daa8-527f-4ae0-af79-28aeb2ae5757 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.285301 Jun 23 22:48:15.681980 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 209/427] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:15 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:16.172124 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:16.173408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:16.183845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:16.187570 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:16.194025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:16.196703 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:16.421315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:16.436170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:16.438455 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:16.440542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-12784e66-2c4c-4898-b189-20709978fe06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.273091 Jun 23 22:48:16.457883 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 219/428] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:16 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:16.689844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b24c1b27-22bf-4719-b622-df5f16da7402 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:16.691189 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b24c1b27-22bf-4719-b622-df5f16da7402 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:16.702259 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b24c1b27-22bf-4719-b622-df5f16da7402 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:16.703509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b24c1b27-22bf-4719-b622-df5f16da7402 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:16.704790 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b24c1b27-22bf-4719-b622-df5f16da7402 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:16.705467 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b24c1b27-22bf-4719-b622-df5f16da7402 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:16.897922 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b24c1b27-22bf-4719-b622-df5f16da7402 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:16.908719 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b24c1b27-22bf-4719-b622-df5f16da7402 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.223106 Jun 23 22:48:16.916316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 210/429] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:16 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:17.460213 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:17.460829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:17.467038 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:17.467539 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:17.468309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:17.468958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:17.670494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:17.682094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:17.691434 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:17.695172 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2f6d7787-159b-4bf6-ad49-e6224443bed1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.239065 Jun 23 22:48:17.707441 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 220/430] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:17 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:17.932993 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-74d279ba-b015-4b88-b270-c53a18dd417f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:17.933599 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-74d279ba-b015-4b88-b270-c53a18dd417f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:17.937127 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:17.940939 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-74d279ba-b015-4b88-b270-c53a18dd417f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:17.941608 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-74d279ba-b015-4b88-b270-c53a18dd417f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:17.942624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-74d279ba-b015-4b88-b270-c53a18dd417f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:17.943336 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-74d279ba-b015-4b88-b270-c53a18dd417f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:18.127749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-74d279ba-b015-4b88-b270-c53a18dd417f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:18.137555 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-74d279ba-b015-4b88-b270-c53a18dd417f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.208454 Jun 23 22:48:18.138400 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 211/431] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:17 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:18.713456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:18.714074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:18.720133 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:18.720596 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:18.721381 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:18.721823 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:18.851583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:18.859756 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:18.861278 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:18.862426 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-78457315-4eb9-43ce-a349-8cb2ba7e52ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.153042 Jun 23 22:48:18.862976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 221/432] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:18 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:19.154860 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-78e16548-8408-45c6-aabc-2bab5a5b09f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:19.155619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-78e16548-8408-45c6-aabc-2bab5a5b09f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:19.165030 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-78e16548-8408-45c6-aabc-2bab5a5b09f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:19.165483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-78e16548-8408-45c6-aabc-2bab5a5b09f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:19.166546 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-78e16548-8408-45c6-aabc-2bab5a5b09f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:19.166685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-78e16548-8408-45c6-aabc-2bab5a5b09f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:19.351619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-78e16548-8408-45c6-aabc-2bab5a5b09f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:19.359816 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-78e16548-8408-45c6-aabc-2bab5a5b09f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1371 microversion: 2.1 time: 0.208725 Jun 23 22:48:19.370666 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 212/433] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:19 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1371 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:19.883616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:19.883616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:19.888792 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:19.889246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:19.890001 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:19.890624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:20.047785 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:20.057242 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:20.059097 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:20.060238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-195d2c45-3db6-4e5c-b74a-f34c980debdb tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1739 microversion: 2.20 time: 0.182632 Jun 23 22:48:20.060814 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 222/434] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:19 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:20.377420 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-137fef9f-00f4-43ba-ac0e-b8390b6e243d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:20.382130 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-137fef9f-00f4-43ba-ac0e-b8390b6e243d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:20.385069 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-137fef9f-00f4-43ba-ac0e-b8390b6e243d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:20.385514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-137fef9f-00f4-43ba-ac0e-b8390b6e243d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:20.386271 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-137fef9f-00f4-43ba-ac0e-b8390b6e243d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:20.386699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-137fef9f-00f4-43ba-ac0e-b8390b6e243d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:20.588868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-137fef9f-00f4-43ba-ac0e-b8390b6e243d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:20.597010 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-137fef9f-00f4-43ba-ac0e-b8390b6e243d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1565 microversion: 2.1 time: 0.223498 Jun 23 22:48:20.597711 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 213/435] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:20 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1565 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:20.614516 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-03b9f0f1-f470-48db-9f1a-ec78ef44c177 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:20.615161 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-03b9f0f1-f470-48db-9f1a-ec78ef44c177 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:20.621490 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-03b9f0f1-f470-48db-9f1a-ec78ef44c177 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:20.621943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-03b9f0f1-f470-48db-9f1a-ec78ef44c177 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:20.622711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-03b9f0f1-f470-48db-9f1a-ec78ef44c177 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:20.623150 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-03b9f0f1-f470-48db-9f1a-ec78ef44c177 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:20.704107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-03b9f0f1-f470-48db-9f1a-ec78ef44c177 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093390 Jun 23 22:48:20.704735 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 223/436] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 22:48:20 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:48:21.078933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:21.079646 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:21.086043 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:21.086536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:21.087296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:21.087727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:21.220669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:21.229064 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:21.230580 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:21.231736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-82aebf1e-82f3-40ec-ad10-98a3307a5362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1721 microversion: 2.20 time: 0.156695 Jun 23 22:48:21.232292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 214/437] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:21 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:21.707261 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-a0ec3648-eda2-4c52-a989-e4698f141d25 req-83518be6-b4b0-4358-ba13-d6372b64162c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dafd3dc-6a6c-4a96-854d-e380a187a72b", "tag": "605d9a1c-2adc-425e-a04a-51601319bff5"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:21.716300 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-a0ec3648-eda2-4c52-a989-e4698f141d25 req-83518be6-b4b0-4358-ba13-d6372b64162c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:21.716792 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-a0ec3648-eda2-4c52-a989-e4698f141d25 req-83518be6-b4b0-4358-ba13-d6372b64162c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:21.729988 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-a0ec3648-eda2-4c52-a989-e4698f141d25 req-83518be6-b4b0-4358-ba13-d6372b64162c service nova] Creating event network-changed:605d9a1c-2adc-425e-a04a-51601319bff5 for instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b on hv-cinder-81322 Jun 23 22:48:21.735561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-a0ec3648-eda2-4c52-a989-e4698f141d25 req-83518be6-b4b0-4358-ba13-d6372b64162c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031919 Jun 23 22:48:21.736444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 224/438] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:48:22.251263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:22.251998 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:22.259621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:22.260408 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:22.261858 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:22.263438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:22.406207 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:22.409642 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:22.415150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:22.416665 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:22.417865 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-15c9e5b2-09f8-4aef-9215-59204299a50a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1721 microversion: 2.20 time: 0.170526 Jun 23 22:48:22.418402 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 215/439] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:22 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:23.436650 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:23.437419 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:23.443917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:23.444367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:23.445155 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:23.445592 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:23.573906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:23.582513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:23.588501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:23.588501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-36379dec-37a7-40fd-ba8f-0f503568271b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1721 microversion: 2.20 time: 0.153530 Jun 23 22:48:23.588501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 225/440] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:23 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:24.604825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:24.606292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:24.615628 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:24.615628 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:24.619067 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:24.619420 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:24.648780 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-05ce9ab6-d6e3-4b7f-8bee-c4292f1b7f48 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:24.649364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-05ce9ab6-d6e3-4b7f-8bee-c4292f1b7f48 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:24.656088 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05ce9ab6-d6e3-4b7f-8bee-c4292f1b7f48 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:24.656088 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05ce9ab6-d6e3-4b7f-8bee-c4292f1b7f48 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:24.657179 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05ce9ab6-d6e3-4b7f-8bee-c4292f1b7f48 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:24.657610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05ce9ab6-d6e3-4b7f-8bee-c4292f1b7f48 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:24.800812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-05ce9ab6-d6e3-4b7f-8bee-c4292f1b7f48 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lazy-loading 'services' on Instance uuid a91ce156-8955-4253-becd-3bd35d1b030e {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:48:24.997820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-05ce9ab6-d6e3-4b7f-8bee-c4292f1b7f48 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e/os-volume_attachments/7caa8da9-60a0-4c53-bcf8-277104d55200" status: 202 len: 0 microversion: 2.1 time: 0.353041 Jun 23 22:48:24.998403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 226/441] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:48:24 2022] DELETE /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e/os-volume_attachments/7caa8da9-60a0-4c53-bcf8-277104d55200 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 22:48:25.015404 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:25.023400 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:25.025179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:25.026336 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fa65decb-cc59-4b21-9792-8f3c01102683 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1721 microversion: 2.20 time: 0.426121 Jun 23 22:48:25.026888 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 216/442] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:24 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1721 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:25.693863 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-6c9f4936-7570-4205-8a7c-380e80f90280 req-c7563455-250c-40bc-aef1-9463b58d5de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286fefab-3729-4c09-a3be-0af864c6de65", "name": "network-vif-unplugged", "status": "completed", "tag": "b2734dfe-80ab-464a-85a5-81204d7db18e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:25.703079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-6c9f4936-7570-4205-8a7c-380e80f90280 req-c7563455-250c-40bc-aef1-9463b58d5de3 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:25.703582 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-6c9f4936-7570-4205-8a7c-380e80f90280 req-c7563455-250c-40bc-aef1-9463b58d5de3 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:25.714765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-6c9f4936-7570-4205-8a7c-380e80f90280 req-c7563455-250c-40bc-aef1-9463b58d5de3 service nova] Creating event network-vif-unplugged:b2734dfe-80ab-464a-85a5-81204d7db18e for instance 286fefab-3729-4c09-a3be-0af864c6de65 on hv-cinder-81322 Jun 23 22:48:25.719576 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-6c9f4936-7570-4205-8a7c-380e80f90280 req-c7563455-250c-40bc-aef1-9463b58d5de3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029881 Jun 23 22:48:25.720146 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 227/443] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:48:26.043949 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:26.044655 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:26.052232 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:26.052718 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:26.053486 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:26.053921 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:26.193755 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:26.201579 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:26.203078 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:26.204218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-89455039-fe07-4be4-ae6e-483925457c74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1721 microversion: 2.20 time: 0.164213 Jun 23 22:48:26.204801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 217/444] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:26 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:27.224393 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:27.225117 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:27.231341 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:27.231791 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:27.232546 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:27.233009 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:27.375942 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:27.384214 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:27.385752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:27.386909 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0018e030-8746-4fe3-b750-720d64b627c9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1721 microversion: 2.20 time: 0.167432 Jun 23 22:48:27.387461 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 228/445] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:27 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:28.405445 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:28.406086 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:28.413233 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:28.413674 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:28.414426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:28.414857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:28.553014 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:28.560413 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:28.561943 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:28.563088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-77bad768-e809-4ad6-a460-32e8b7dbc7ce tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1721 microversion: 2.20 time: 0.161518 Jun 23 22:48:28.563626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 218/446] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:28 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:29.581159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:29.581765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:29.587896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:29.588398 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:29.589194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:29.589664 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:29.593831 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:29.728685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:29.736882 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:29.738389 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:29.740212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b87ec6f2-4b43-47c3-a25a-28e1b99bd284 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1724 microversion: 2.20 time: 0.162874 Jun 23 22:48:29.740795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 229/447] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:29 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:29.758841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6e81b9f6-30fb-44d4-a4fe-78d2cee8fa7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5634d54c-320b-4100-91dc-cde76e2583b6"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:29.759895 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6e81b9f6-30fb-44d4-a4fe-78d2cee8fa7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:29.766543 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e81b9f6-30fb-44d4-a4fe-78d2cee8fa7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:29.770775 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e81b9f6-30fb-44d4-a4fe-78d2cee8fa7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:29.770775 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e81b9f6-30fb-44d4-a4fe-78d2cee8fa7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:29.770775 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e81b9f6-30fb-44d4-a4fe-78d2cee8fa7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:30.345610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8254cca1-e061-46b6-b95b-810cdd489bb0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:30.346099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8254cca1-e061-46b6-b95b-810cdd489bb0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:30.352824 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8254cca1-e061-46b6-b95b-810cdd489bb0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:30.353275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8254cca1-e061-46b6-b95b-810cdd489bb0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:30.354132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8254cca1-e061-46b6-b95b-810cdd489bb0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:30.354566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8254cca1-e061-46b6-b95b-810cdd489bb0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:30.382010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8254cca1-e061-46b6-b95b-810cdd489bb0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:48:30.672051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8254cca1-e061-46b6-b95b-810cdd489bb0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 204 len: 0 microversion: 2.1 time: 0.329734 Jun 23 22:48:30.672728 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 230/448] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:48:30 2022] DELETE /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:48:30.682398 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-93f1c0b6-8663-4fd4-b8fc-12f135df63c7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:30.683106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-93f1c0b6-8663-4fd4-b8fc-12f135df63c7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:30.689527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-93f1c0b6-8663-4fd4-b8fc-12f135df63c7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:30.690071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-93f1c0b6-8663-4fd4-b8fc-12f135df63c7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:30.690854 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-93f1c0b6-8663-4fd4-b8fc-12f135df63c7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:30.691290 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-93f1c0b6-8663-4fd4-b8fc-12f135df63c7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:30.825613 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-93f1c0b6-8663-4fd4-b8fc-12f135df63c7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:30.833763 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-93f1c0b6-8663-4fd4-b8fc-12f135df63c7 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1514 microversion: 2.1 time: 0.155903 Jun 23 22:48:30.834466 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 231/449] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:30 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:48:30.893971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6e81b9f6-30fb-44d4-a4fe-78d2cee8fa7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.139427 Jun 23 22:48:30.895145 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 219/450] 10.222.0.33 () {62 vars in 1363 bytes} [Thu Jun 23 22:48:29 2022] POST /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments => generated 188 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:48:31.007568 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:31.008159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:31.014149 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:31.014594 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:31.015340 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:31.015773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:31.277299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [94ffdc2d-f82d-4f15-b332-5dca53d3f5f1] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 22:48:31.850359 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e4d4e13a-2c2d-4704-a652-04e3d66c49d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:31.850967 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e4d4e13a-2c2d-4704-a652-04e3d66c49d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:31.857906 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4d4e13a-2c2d-4704-a652-04e3d66c49d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:31.858361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4d4e13a-2c2d-4704-a652-04e3d66c49d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:31.859123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4d4e13a-2c2d-4704-a652-04e3d66c49d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:31.859566 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e4d4e13a-2c2d-4704-a652-04e3d66c49d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:31.987449 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e4d4e13a-2c2d-4704-a652-04e3d66c49d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:31.996022 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e4d4e13a-2c2d-4704-a652-04e3d66c49d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1514 microversion: 2.1 time: 0.149495 Jun 23 22:48:31.996600 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 220/451] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:31 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:48:32.283874 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [94ffdc2d-f82d-4f15-b332-5dca53d3f5f1] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 56580. Jun 23 22:48:32.288121 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-eb0ce58f-2fbd-4699-9e3a-3cc35c7b2eaa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/action" status: 202 len: 0 microversion: 2.20 time: 1.284496 Jun 23 22:48:32.288916 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 232/452] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 23 22:48:31 2022] POST /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/action => generated 0 bytes in 1286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:48:32.296691 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:32.297333 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:32.303693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:32.304137 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:32.304937 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:32.305376 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:32.442451 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:32.451060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:32.452547 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:32.453726 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5081562c-59db-495b-9df2-a350a5ff9c06 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1750 microversion: 2.20 time: 0.160932 Jun 23 22:48:32.454276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 221/453] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:32 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:33.013160 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3d629d7b-0aa0-4294-a16c-9ac88633a627 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:33.013967 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3d629d7b-0aa0-4294-a16c-9ac88633a627 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:33.021887 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3d629d7b-0aa0-4294-a16c-9ac88633a627 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:33.023685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3d629d7b-0aa0-4294-a16c-9ac88633a627 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:33.023685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3d629d7b-0aa0-4294-a16c-9ac88633a627 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:33.023848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3d629d7b-0aa0-4294-a16c-9ac88633a627 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:33.163982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3d629d7b-0aa0-4294-a16c-9ac88633a627 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:33.171766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3d629d7b-0aa0-4294-a16c-9ac88633a627 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1514 microversion: 2.1 time: 0.162472 Jun 23 22:48:33.172333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 233/454] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:33 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:33.472392 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:33.473737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:33.480351 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:33.480838 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:33.481610 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:33.482051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:33.614639 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:33.623634 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:33.625221 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:33.626382 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b20faf8f-5c27-48a0-9fe9-9d608518c5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1750 microversion: 2.20 time: 0.157787 Jun 23 22:48:33.626937 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 222/455] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:33 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:34.188925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ead2daf2-4521-47a2-85eb-2cd6d02f80cc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:34.189534 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ead2daf2-4521-47a2-85eb-2cd6d02f80cc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:34.195993 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ead2daf2-4521-47a2-85eb-2cd6d02f80cc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:34.196449 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ead2daf2-4521-47a2-85eb-2cd6d02f80cc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:34.197229 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ead2daf2-4521-47a2-85eb-2cd6d02f80cc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:34.197657 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ead2daf2-4521-47a2-85eb-2cd6d02f80cc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:34.326012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ead2daf2-4521-47a2-85eb-2cd6d02f80cc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:34.334386 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ead2daf2-4521-47a2-85eb-2cd6d02f80cc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1514 microversion: 2.1 time: 0.149264 Jun 23 22:48:34.334948 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 234/456] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:34 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:34.645136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:34.645739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:34.652549 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:34.653154 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:34.653936 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:34.654368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:34.784802 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:34.793125 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:34.794609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:34.795770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7e6f9200-7117-42f8-85b5-c7bd9cb8266e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1750 microversion: 2.20 time: 0.154626 Jun 23 22:48:34.796321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 223/457] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:34 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:35.351444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-23109e57-6167-48f8-bffb-45e9eb722820 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:35.352048 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-23109e57-6167-48f8-bffb-45e9eb722820 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:35.358178 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23109e57-6167-48f8-bffb-45e9eb722820 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:35.358648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23109e57-6167-48f8-bffb-45e9eb722820 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:35.359397 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23109e57-6167-48f8-bffb-45e9eb722820 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:35.359823 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23109e57-6167-48f8-bffb-45e9eb722820 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:35.484392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-23109e57-6167-48f8-bffb-45e9eb722820 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:35.492261 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-23109e57-6167-48f8-bffb-45e9eb722820 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1514 microversion: 2.1 time: 0.145200 Jun 23 22:48:35.492830 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 235/458] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:35 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:35.814095 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:35.814701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:35.821788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:35.822236 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:35.822990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:35.823423 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:35.948233 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:35.956531 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:35.958094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:35.959739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7a9a271f-cfba-462b-8104-16b294122260 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1750 microversion: 2.20 time: 0.149533 Jun 23 22:48:35.960284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 224/459] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:35 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:36.509046 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-730cceba-f3ef-458e-8efc-f57de09aca18 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:36.509650 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-730cceba-f3ef-458e-8efc-f57de09aca18 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:36.515606 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-730cceba-f3ef-458e-8efc-f57de09aca18 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:36.516046 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-730cceba-f3ef-458e-8efc-f57de09aca18 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:36.516833 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-730cceba-f3ef-458e-8efc-f57de09aca18 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:36.517264 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-730cceba-f3ef-458e-8efc-f57de09aca18 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:36.649253 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-730cceba-f3ef-458e-8efc-f57de09aca18 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:36.656587 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-730cceba-f3ef-458e-8efc-f57de09aca18 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1514 microversion: 2.1 time: 0.151371 Jun 23 22:48:36.657149 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 236/460] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:36 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:36.979124 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:36.979651 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:36.986182 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:36.986627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:36.987381 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:36.987813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:37.118734 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:37.126972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:37.128488 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:37.129665 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5c126030-bc00-4692-bc82-7a24ef555ee3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1750 microversion: 2.20 time: 0.155137 Jun 23 22:48:37.130223 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 225/461] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:36 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:37.674117 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-126674b7-0906-47f0-bbb7-db69e86a50b1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:37.674635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-126674b7-0906-47f0-bbb7-db69e86a50b1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:37.680806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-126674b7-0906-47f0-bbb7-db69e86a50b1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:37.681253 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-126674b7-0906-47f0-bbb7-db69e86a50b1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:37.681996 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-126674b7-0906-47f0-bbb7-db69e86a50b1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:37.682424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-126674b7-0906-47f0-bbb7-db69e86a50b1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:37.810074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-126674b7-0906-47f0-bbb7-db69e86a50b1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:37.817584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-126674b7-0906-47f0-bbb7-db69e86a50b1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1514 microversion: 2.1 time: 0.147351 Jun 23 22:48:37.818151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 237/462] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:37 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:38.149407 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:38.150173 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:38.157275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:38.157794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:38.158624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:38.159121 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:38.382716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:38.391264 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:38.392820 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:38.393974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c6426e3f-d71f-4a3f-a514-3b8de7642e88 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1752 microversion: 2.20 time: 0.249484 Jun 23 22:48:38.394532 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 226/463] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:38 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1752 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:38.695964 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-4314d24f-5c22-46c8-92aa-56d961f756f4 req-d2566e3c-6e5d-463d-89eb-6c291510ea92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91ce156-8955-4253-becd-3bd35d1b030e", "name": "network-vif-deleted", "tag": "ab698d23-d25f-4bae-b29e-f19d0e6de684"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:38.704081 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-4314d24f-5c22-46c8-92aa-56d961f756f4 req-d2566e3c-6e5d-463d-89eb-6c291510ea92 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:38.704533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-4314d24f-5c22-46c8-92aa-56d961f756f4 req-d2566e3c-6e5d-463d-89eb-6c291510ea92 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:38.716118 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-4314d24f-5c22-46c8-92aa-56d961f756f4 req-d2566e3c-6e5d-463d-89eb-6c291510ea92 service nova] Creating event network-vif-deleted:ab698d23-d25f-4bae-b29e-f19d0e6de684 for instance a91ce156-8955-4253-becd-3bd35d1b030e on hv-cinder-81322 Jun 23 22:48:38.721311 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-4314d24f-5c22-46c8-92aa-56d961f756f4 req-d2566e3c-6e5d-463d-89eb-6c291510ea92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029008 Jun 23 22:48:38.721953 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 238/464] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:48:38.834834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a8a8e97e-b2a1-4484-bcc6-60b0217ff19a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:38.835633 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a8a8e97e-b2a1-4484-bcc6-60b0217ff19a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:38.842136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8a8e97e-b2a1-4484-bcc6-60b0217ff19a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:38.842582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8a8e97e-b2a1-4484-bcc6-60b0217ff19a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:38.843391 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8a8e97e-b2a1-4484-bcc6-60b0217ff19a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:38.843830 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a8a8e97e-b2a1-4484-bcc6-60b0217ff19a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:38.917671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a8a8e97e-b2a1-4484-bcc6-60b0217ff19a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:38.926017 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a8a8e97e-b2a1-4484-bcc6-60b0217ff19a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 200 len: 1303 microversion: 2.1 time: 0.095567 Jun 23 22:48:38.926581 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 227/465] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:38 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:39.413610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:39.414319 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:39.420789 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:39.421241 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:39.421998 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:39.422432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:39.801271 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:39.810357 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:39.811851 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:39.813034 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3d052db8-b864-4d48-badc-4a296eb33be8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1752 microversion: 2.20 time: 0.403862 Jun 23 22:48:39.814875 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 239/466] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:39 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1752 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:39.945447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:39.946055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: a91ce156-8955-4253-becd-3bd35d1b030e] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:39.952526 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:39.952992 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:39.953739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:39.954169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:39.968249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] HTTP exception thrown: Instance a91ce156-8955-4253-becd-3bd35d1b030e could not be found. Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Request method failure captured: Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e HTTP/1.1 Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO1eMzFVc3rzLzmfG6GGu1NFSaCn9Ywjbl487QGZDU1-SZVCCUzhiHgkEH5RMOLwQY9rZIy1uRJj1R7-Pt6XAq2ckvZQwlP0TJfdOCywF93GF6C1jJ4lc_W-qc-Lhl3u039Vqde9xjICUJp4lABxIbqeYR8mgzElPyZLefPXTmTLXZE Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: cb1c26e7fcbd4c0c9bb4a68e54569e3a Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesSnapshotTestJSON-33166903 Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:48:39.969818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cb1c26e7fcbd4c0c9bb4a68e54569e3a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cb1c26e7fcbd4c0c9bb4a68e54569e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb1c26e7fcbd4c0c9bb4a68e54569e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb1c26e7fcbd4c0c9bb4a68e54569e3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesSnapshotTestJSON-33166903 Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: cb1c26e7fcbd4c0c9bb4a68e54569e3a Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-33166903 Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesSnapshotTestJSON-33166903-project Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: dd98b2a31e4c46599269684782915703 Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesSnapshotTestJSON-33166903-project Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance a91ce156-8955-4253-becd-3bd35d1b030e could not be found. Jun 23 22:48:39.971424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': 'a91ce156-8955-4253-becd-3bd35d1b030e'} Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91ce156-8955-4253-becd-3bd35d1b030e could not be found. Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:48:39.972339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91ce156-8955-4253-becd-3bd35d1b030e could not be found. Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91ce156-8955-4253-becd-3bd35d1b030e could not be found. Jun 23 22:48:39.973801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:48:39.975804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Returning 404 to user: Instance a91ce156-8955-4253-becd-3bd35d1b030e could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:48:39.975804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-18734b81-9264-4f43-b059-89f2931d8d80 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e" status: 404 len: 111 microversion: 2.1 time: 0.029611 Jun 23 22:48:39.975804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 228/467] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:39 2022] GET /compute/v2.1/servers/a91ce156-8955-4253-becd-3bd35d1b030e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:48:40.831185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:40.831743 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:40.837886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:40.838338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:40.839100 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:40.839545 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:40.965635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:40.973976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:40.976151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:40.977345 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-31eed553-c802-4cc3-ae6a-0d0c01bb5b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.150284 Jun 23 22:48:40.977899 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 240/468] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:40 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:41.996313 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:41.996941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:42.003452 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:42.003890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:42.004664 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:42.005094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:42.140075 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:42.148818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:42.150320 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:42.151470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-92fc07c4-b8a2-45ac-a3a1-3c17c83375b5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.159066 Jun 23 22:48:42.152012 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 229/469] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:41 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:43.169498 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:43.170094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:43.176352 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:43.186202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:43.186202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:43.186202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:43.325465 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:43.334752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:43.336338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:43.337626 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-41f67171-2fa4-4c81-be0f-e145562ccb30 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.172570 Jun 23 22:48:43.338310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 241/470] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:43 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:44.357403 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:44.359095 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:44.369281 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:44.370031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:44.371004 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:44.371632 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:44.391600 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:44.508715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:44.520364 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:44.520364 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:44.520593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-561fc2a0-dc34-447a-90ae-b894fe46e6c3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.167995 Jun 23 22:48:44.521005 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 230/471] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:44 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:45.538987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:45.539890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:45.543276 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:45.547358 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:45.547812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:45.548601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:45.549349 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:45.687485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:45.696603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:45.698076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:45.699216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2a8ce2b3-ccbc-4706-971e-6f3e4f1e6382 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.164196 Jun 23 22:48:45.699763 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 242/472] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:45 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:46.718051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:46.718754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:46.730824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:46.731270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:46.732053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:46.732490 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:46.903685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:46.913488 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:46.915045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:46.916218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9ef31e68-764e-4941-bb18-01cdc88fda1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.202175 Jun 23 22:48:46.916801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 231/473] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:46 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:47.934749 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:47.935477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:47.941727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:47.942256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:47.943223 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:47.943657 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:48.085592 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:48.090416 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:48.100349 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:48.104954 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:48.104954 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e8e75565-5a1a-4818-ba4a-99dca55da071 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.173152 Jun 23 22:48:48.104954 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 243/474] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:47 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:49.127333 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:49.127955 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:49.130352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=42 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:48:49.135761 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:49.136208 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:49.137098 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:49.137533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:49.267380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:49.276969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:49.278454 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:49.279596 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dd589bf1-8074-4c8d-8332-148eabe82caf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.156262 Jun 23 22:48:49.280137 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 232/475] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:49 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:50.297795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:50.298397 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:50.305210 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:50.305643 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:50.306385 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:50.306812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:50.436276 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:50.444727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:50.446776 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:50.447921 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-de88c6e9-4232-4fc4-b93d-b33514c70c2e tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.154355 Jun 23 22:48:50.448477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 244/476] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:50 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:50.670170 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-733206536", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "networks": [{"uuid": "943907ef-568e-43a8-9aea-901197e36bb3"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:48:50.720596 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] validate_networks() for [('943907ef-568e-43a8-9aea-901197e36bb3', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:48:51.075318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:48:51.075741 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:48:51.076213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:48:51.076637 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:48:51.077048 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:48:51.087684 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:51.088075 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:51.089021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:51.089461 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:51.107682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Getting quotas for project cb1c26e7fcbd4c0c9bb4a68e54569e3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:48:51.111857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Getting quotas for user dd98b2a31e4c46599269684782915703 and project cb1c26e7fcbd4c0c9bb4a68e54569e3a. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:48:51.123529 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:48:51.125855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:48:51.260531 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cc02736b-fb4f-4c85-8217-d77911f399f8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594115 Jun 23 22:48:51.261201 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 233/477] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:48:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:48:51.271019 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cc1562a0-7703-4b28-9d9f-41c6df3e30b8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:51.271646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cc1562a0-7703-4b28-9d9f-41c6df3e30b8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:51.328643 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cc1562a0-7703-4b28-9d9f-41c6df3e30b8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:51.336014 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cc1562a0-7703-4b28-9d9f-41c6df3e30b8 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1218 microversion: 2.1 time: 0.068149 Jun 23 22:48:51.336475 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 245/478] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:51 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:51.466936 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:51.467725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:51.474980 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:51.475573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:51.477284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:51.477880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:51.618824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:51.627698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:51.629358 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:51.630520 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a6288bbf-a1ce-44df-a74b-dfb2a1af5d3b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.167732 Jun 23 22:48:51.631078 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 234/479] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:51 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:52.353391 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-86714c5e-b4ef-45b2-9570-38100d251de1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:52.354709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-86714c5e-b4ef-45b2-9570-38100d251de1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:52.361040 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86714c5e-b4ef-45b2-9570-38100d251de1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:52.361704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86714c5e-b4ef-45b2-9570-38100d251de1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:52.362673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86714c5e-b4ef-45b2-9570-38100d251de1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:52.363316 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86714c5e-b4ef-45b2-9570-38100d251de1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:52.425021 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-86714c5e-b4ef-45b2-9570-38100d251de1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:52.433135 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-86714c5e-b4ef-45b2-9570-38100d251de1 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1222 microversion: 2.1 time: 0.084342 Jun 23 22:48:52.433686 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 246/480] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:52 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:52.650375 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:52.651171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:52.658044 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:52.658566 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:52.659393 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:52.659886 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:52.794834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:52.803304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:52.804889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:52.805948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-07245cdb-86ad-4052-b203-9d34b5670e3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.160805 Jun 23 22:48:52.811024 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 235/481] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:52 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:53.449792 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7352de8c-2634-4fa8-830d-6e1cef0712dc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:53.450466 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7352de8c-2634-4fa8-830d-6e1cef0712dc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:53.456666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7352de8c-2634-4fa8-830d-6e1cef0712dc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:53.457119 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7352de8c-2634-4fa8-830d-6e1cef0712dc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:53.457878 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7352de8c-2634-4fa8-830d-6e1cef0712dc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:53.458312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7352de8c-2634-4fa8-830d-6e1cef0712dc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:53.517070 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7352de8c-2634-4fa8-830d-6e1cef0712dc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:53.524490 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7352de8c-2634-4fa8-830d-6e1cef0712dc tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1222 microversion: 2.1 time: 0.078657 Jun 23 22:48:53.525071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 247/482] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:53 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:53.824767 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:53.825757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:53.833176 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:53.833673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:53.834532 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:53.835005 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:53.966126 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:53.974430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:53.975956 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:53.977138 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0bd7d079-e426-44ad-b213-98b4145a3c23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.157618 Jun 23 22:48:53.977686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 236/483] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:53 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:54.541370 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e150493a-ba31-47ae-8d4f-c29760e37704 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:54.541900 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e150493a-ba31-47ae-8d4f-c29760e37704 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:54.547867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e150493a-ba31-47ae-8d4f-c29760e37704 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:54.548319 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e150493a-ba31-47ae-8d4f-c29760e37704 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:54.549110 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e150493a-ba31-47ae-8d4f-c29760e37704 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:54.549550 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e150493a-ba31-47ae-8d4f-c29760e37704 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:54.608796 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e150493a-ba31-47ae-8d4f-c29760e37704 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:54.616714 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e150493a-ba31-47ae-8d4f-c29760e37704 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1222 microversion: 2.1 time: 0.079023 Jun 23 22:48:54.617361 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 248/484] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:54 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:54.996245 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:54.996981 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:55.003184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:55.003627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:55.004417 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:55.004827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:55.145971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:55.156462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:55.158368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:55.159787 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dc3aa687-3437-4263-8b3e-397514d95497 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.167554 Jun 23 22:48:55.170766 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 237/485] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:54 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:55.640663 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-706b52b4-5299-49d1-b73f-9e3a6957b17c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:55.640663 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-706b52b4-5299-49d1-b73f-9e3a6957b17c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:55.640663 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-706b52b4-5299-49d1-b73f-9e3a6957b17c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:55.640663 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-706b52b4-5299-49d1-b73f-9e3a6957b17c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:55.641644 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-706b52b4-5299-49d1-b73f-9e3a6957b17c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:55.641827 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-706b52b4-5299-49d1-b73f-9e3a6957b17c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:55.704492 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-706b52b4-5299-49d1-b73f-9e3a6957b17c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:55.712620 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-706b52b4-5299-49d1-b73f-9e3a6957b17c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1222 microversion: 2.1 time: 0.083823 Jun 23 22:48:55.713286 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 249/486] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:55 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:56.180806 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:56.181415 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:56.187825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:56.188261 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:56.189031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:56.189459 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:56.319117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:56.332141 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:56.337480 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:56.337480 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d0ae73ff-f2f0-483c-a85e-be80f298ec72 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.158538 Jun 23 22:48:56.337480 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 238/487] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:56 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:56.730424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-74b64b05-c1c3-40c5-9e50-d19f76c2358c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:56.731072 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-74b64b05-c1c3-40c5-9e50-d19f76c2358c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:56.737263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-74b64b05-c1c3-40c5-9e50-d19f76c2358c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:56.737721 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-74b64b05-c1c3-40c5-9e50-d19f76c2358c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:56.738481 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-74b64b05-c1c3-40c5-9e50-d19f76c2358c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:56.738919 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-74b64b05-c1c3-40c5-9e50-d19f76c2358c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:56.809031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-74b64b05-c1c3-40c5-9e50-d19f76c2358c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:56.818376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-74b64b05-c1c3-40c5-9e50-d19f76c2358c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1222 microversion: 2.1 time: 0.092621 Jun 23 22:48:56.819626 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 250/488] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:56 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:57.354372 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:57.355765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:57.362982 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.363511 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.364353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.365155 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.498721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:57.509040 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:57.510557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:57.511770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c4d436e6-068d-4b99-855a-ed2df635ee15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.161553 Jun 23 22:48:57.512315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 239/489] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:57 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:57.835132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0bdf94e5-68a6-496b-b592-87e779e02f78 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:57.835737 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0bdf94e5-68a6-496b-b592-87e779e02f78 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:57.841850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0bdf94e5-68a6-496b-b592-87e779e02f78 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.842293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0bdf94e5-68a6-496b-b592-87e779e02f78 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.843051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0bdf94e5-68a6-496b-b592-87e779e02f78 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:57.843484 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0bdf94e5-68a6-496b-b592-87e779e02f78 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:57.902819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0bdf94e5-68a6-496b-b592-87e779e02f78 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:57.909924 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0bdf94e5-68a6-496b-b592-87e779e02f78 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1222 microversion: 2.1 time: 0.078581 Jun 23 22:48:57.910478 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 251/490] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:57 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:58.530960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:58.531560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:58.538087 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:58.538526 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:58.539963 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:58.540340 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:58.666934 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:58.675404 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:58.676962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:58.678106 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-903e45b5-b275-4bce-9e14-ab91bfdb7674 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.151103 Jun 23 22:48:58.678657 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 240/491] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:58 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:48:58.926705 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-05c7155f-4517-4ab8-ad0a-6ec77bd46a54 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:58.927242 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-05c7155f-4517-4ab8-ad0a-6ec77bd46a54 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:58.933356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05c7155f-4517-4ab8-ad0a-6ec77bd46a54 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:58.937757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05c7155f-4517-4ab8-ad0a-6ec77bd46a54 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:58.937757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05c7155f-4517-4ab8-ad0a-6ec77bd46a54 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:58.937757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05c7155f-4517-4ab8-ad0a-6ec77bd46a54 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:58.994871 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-05c7155f-4517-4ab8-ad0a-6ec77bd46a54 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:59.002325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-05c7155f-4517-4ab8-ad0a-6ec77bd46a54 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1222 microversion: 2.1 time: 0.079613 Jun 23 22:48:59.003582 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 252/492] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:48:58 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:48:59.696144 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:48:59.696926 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:48:59.704212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:59.704850 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:59.705686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:48:59.706116 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:48:59.869688 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:59.878166 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:59.879712 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:48:59.880889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-998f884a-3215-4b5a-97fc-4403dbb32808 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.188747 Jun 23 22:48:59.881448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 241/493] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:48:59 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:00.019195 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-66696a9f-94e0-4f96-b57e-a9174d4e0444 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:00.020593 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-66696a9f-94e0-4f96-b57e-a9174d4e0444 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:00.028258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-66696a9f-94e0-4f96-b57e-a9174d4e0444 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:00.029011 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-66696a9f-94e0-4f96-b57e-a9174d4e0444 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:00.029985 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-66696a9f-94e0-4f96-b57e-a9174d4e0444 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:00.030881 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-66696a9f-94e0-4f96-b57e-a9174d4e0444 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:00.095127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-66696a9f-94e0-4f96-b57e-a9174d4e0444 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:00.102770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-66696a9f-94e0-4f96-b57e-a9174d4e0444 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1288 microversion: 2.1 time: 0.087259 Jun 23 22:49:00.103697 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 253/494] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:00 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:00.899345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:00.901023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:00.907479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:00.907928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:00.908721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:00.909155 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:01.058166 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:01.066856 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:01.068356 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:01.069553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-80b61a91-0e09-490e-a184-5b332b4f9ced tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.174229 Jun 23 22:49:01.070089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 242/495] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:00 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:01.120358 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2fdddb07-a61b-49f0-a27b-afb39834511c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:01.126547 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2fdddb07-a61b-49f0-a27b-afb39834511c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:01.127650 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2fdddb07-a61b-49f0-a27b-afb39834511c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:01.128103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2fdddb07-a61b-49f0-a27b-afb39834511c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:01.128957 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2fdddb07-a61b-49f0-a27b-afb39834511c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:01.129520 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2fdddb07-a61b-49f0-a27b-afb39834511c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:01.263909 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2fdddb07-a61b-49f0-a27b-afb39834511c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:01.271376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2fdddb07-a61b-49f0-a27b-afb39834511c tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.154998 Jun 23 22:49:01.271938 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 254/496] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:01 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:01.358384 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-c9765cde-7ff0-4be5-a4e5-e4275101f4b8 req-2b67db4f-d6ea-461b-8878-1673790f393c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92576fd0-4632-4e5b-9487-90d4da5a1e04", "tag": "0af3849b-3eda-452d-a709-52a282dbce71"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:01.363333 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:01.363997 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:01.368230 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c9765cde-7ff0-4be5-a4e5-e4275101f4b8 req-2b67db4f-d6ea-461b-8878-1673790f393c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:01.368905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c9765cde-7ff0-4be5-a4e5-e4275101f4b8 req-2b67db4f-d6ea-461b-8878-1673790f393c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:01.385767 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-c9765cde-7ff0-4be5-a4e5-e4275101f4b8 req-2b67db4f-d6ea-461b-8878-1673790f393c service nova] Creating event network-changed:0af3849b-3eda-452d-a709-52a282dbce71 for instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 on hv-cinder-81322 Jun 23 22:49:01.390771 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-c9765cde-7ff0-4be5-a4e5-e4275101f4b8 req-2b67db4f-d6ea-461b-8878-1673790f393c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036083 Jun 23 22:49:01.391377 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 243/497] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:02.088421 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:02.089010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:02.090962 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:02.096227 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:02.103094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:02.103094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:02.103094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:02.231257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:02.239915 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:02.241441 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:02.242604 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a250b2d7-d9b1-46fe-828f-39e91e2af3a4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.158293 Jun 23 22:49:02.243835 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 255/498] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:02 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:02.291512 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f5046668-2ca3-46f7-9f0e-1520191b2758 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:02.292215 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f5046668-2ca3-46f7-9f0e-1520191b2758 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:02.298856 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5046668-2ca3-46f7-9f0e-1520191b2758 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:02.299299 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5046668-2ca3-46f7-9f0e-1520191b2758 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:02.300058 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5046668-2ca3-46f7-9f0e-1520191b2758 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:02.300491 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f5046668-2ca3-46f7-9f0e-1520191b2758 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:02.429821 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f5046668-2ca3-46f7-9f0e-1520191b2758 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:02.437929 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f5046668-2ca3-46f7-9f0e-1520191b2758 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.152456 Jun 23 22:49:02.438488 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 244/499] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:02 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:03.262388 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:03.263052 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:03.269088 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:03.269532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:03.270282 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:03.270708 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:03.400842 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:03.409162 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:03.410653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:03.411794 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a670dcf8-8d23-409a-9a2c-aa8d3e0e3206 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.154259 Jun 23 22:49:03.412360 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 256/500] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:03 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:03.454650 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8a336d7c-6a5b-40d3-aeba-6144598b601d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:03.455259 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8a336d7c-6a5b-40d3-aeba-6144598b601d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:03.462460 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a336d7c-6a5b-40d3-aeba-6144598b601d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:03.462945 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a336d7c-6a5b-40d3-aeba-6144598b601d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:03.463773 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a336d7c-6a5b-40d3-aeba-6144598b601d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:03.464206 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8a336d7c-6a5b-40d3-aeba-6144598b601d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:03.592841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8a336d7c-6a5b-40d3-aeba-6144598b601d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:03.600268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8a336d7c-6a5b-40d3-aeba-6144598b601d tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.149524 Jun 23 22:49:03.600854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 245/501] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:03 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:04.430521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:04.431351 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:04.437423 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.437866 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.438608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.439033 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.566309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:04.574854 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:04.576352 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:04.577523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8b64402c-29e5-4a5c-b836-670accfcdf5d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.150928 Jun 23 22:49:04.578074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 257/502] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:04 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:04.618269 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-42a6885e-37ac-49c8-a169-436b2512d0f6 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:04.619191 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-42a6885e-37ac-49c8-a169-436b2512d0f6 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:04.625685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42a6885e-37ac-49c8-a169-436b2512d0f6 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.626128 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42a6885e-37ac-49c8-a169-436b2512d0f6 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.626886 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42a6885e-37ac-49c8-a169-436b2512d0f6 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.627318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-42a6885e-37ac-49c8-a169-436b2512d0f6 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.661120 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fd795dca-279e-4f61-a183-c548b1f37a58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:04.661611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fd795dca-279e-4f61-a183-c548b1f37a58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:04.668785 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd795dca-279e-4f61-a183-c548b1f37a58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.669239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd795dca-279e-4f61-a183-c548b1f37a58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.670014 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd795dca-279e-4f61-a183-c548b1f37a58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.670454 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd795dca-279e-4f61-a183-c548b1f37a58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.693744 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fd795dca-279e-4f61-a183-c548b1f37a58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96/ips" status: 200 len: 148 microversion: 2.1 time: 0.036420 Jun 23 22:49:04.694317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 258/503] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:49:04 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:49:04.705900 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92ce0f73-e10b-4f18-9997-9511d87d2b34"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:04.707025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:04.714099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.714562 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.715336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.715774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.753991 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-42a6885e-37ac-49c8-a169-436b2512d0f6 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:04.762334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-42a6885e-37ac-49c8-a169-436b2512d0f6 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.148326 Jun 23 22:49:04.762893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 246/504] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:04 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:04.800440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Invalid volume: volume 92ce0f73-e10b-4f18-9997-9511d87d2b34 is already attached to instances: e8042229-5eb7-4d72-a37f-d3d15dff51b8 Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: POST /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96/os-volume_attachments HTTP/1.1 Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 74 Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:49:04.802176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {"volumeAttachment": {"volumeId": "92ce0f73-e10b-4f18-9997-9511d87d2b34"}} Jun 23 22:49:04.803783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Invalid volume: volume 92ce0f73-e10b-4f18-9997-9511d87d2b34 is already attached to instances: e8042229-5eb7-4d72-a37f-d3d15dff51b8 Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'server_id': '63c92940-b145-488a-9b8d-8c500cec9f96', 'body': {'volumeAttachment': {'volumeId': '92ce0f73-e10b-4f18-9997-9511d87d2b34'}}} Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 92ce0f73-e10b-4f18-9997-9511d87d2b34 is already attached to instances: e8042229-5eb7-4d72-a37f-d3d15dff51b8 Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:04.804774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 92ce0f73-e10b-4f18-9997-9511d87d2b34 is already attached to instances: e8042229-5eb7-4d72-a37f-d3d15dff51b8 Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:04.806647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:04.808128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:04.808128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:49:04.808128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:49:04.808128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 92ce0f73-e10b-4f18-9997-9511d87d2b34 is already attached to instances: e8042229-5eb7-4d72-a37f-d3d15dff51b8 Jun 23 22:49:04.808128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:04.808128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 400 to user: Invalid volume: volume 92ce0f73-e10b-4f18-9997-9511d87d2b34 is already attached to instances: e8042229-5eb7-4d72-a37f-d3d15dff51b8 {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:49:04.808128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5a7bb7b3-1a1e-42ba-a3dd-ec2e32a7f8fe tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101707 Jun 23 22:49:04.808128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 259/505] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:49:04 2022] POST /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 23 22:49:04.812858 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9ca69ee8-467a-4867-859a-00b3e73b410a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:04.813346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9ca69ee8-467a-4867-859a-00b3e73b410a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:04.819385 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9ca69ee8-467a-4867-859a-00b3e73b410a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.819775 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9ca69ee8-467a-4867-859a-00b3e73b410a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.820529 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9ca69ee8-467a-4867-859a-00b3e73b410a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:04.820997 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9ca69ee8-467a-4867-859a-00b3e73b410a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:04.846376 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9ca69ee8-467a-4867-859a-00b3e73b410a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:49:04.874111 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:05.173203 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9ca69ee8-467a-4867-859a-00b3e73b410a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 204 len: 0 microversion: 2.1 time: 0.363701 Jun 23 22:49:05.173694 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 247/506] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:49:04 2022] DELETE /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:49:05.182188 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cafb756e-c338-4481-af3e-ba1cc2ddd248 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:05.183014 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cafb756e-c338-4481-af3e-ba1cc2ddd248 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:05.189619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cafb756e-c338-4481-af3e-ba1cc2ddd248 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:05.190062 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cafb756e-c338-4481-af3e-ba1cc2ddd248 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:05.190812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cafb756e-c338-4481-af3e-ba1cc2ddd248 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:05.191241 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cafb756e-c338-4481-af3e-ba1cc2ddd248 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:05.320714 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cafb756e-c338-4481-af3e-ba1cc2ddd248 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:05.329336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cafb756e-c338-4481-af3e-ba1cc2ddd248 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1680 microversion: 2.1 time: 0.151415 Jun 23 22:49:05.329896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 260/507] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:05 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:05.595846 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:05.600456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:05.602965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:05.603414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:05.604201 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:05.604659 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:05.735202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:05.744137 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:05.745668 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:05.746824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2237d2f1-eed6-4e2b-bb98-4108a1fc3ee0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.155308 Jun 23 22:49:05.747378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 248/508] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:05 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:05.779597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7d3abdbf-22c3-42fe-a17b-d7da6233b183 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:05.780211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7d3abdbf-22c3-42fe-a17b-d7da6233b183 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:05.786236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7d3abdbf-22c3-42fe-a17b-d7da6233b183 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:05.786679 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7d3abdbf-22c3-42fe-a17b-d7da6233b183 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:05.787421 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7d3abdbf-22c3-42fe-a17b-d7da6233b183 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:05.787850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7d3abdbf-22c3-42fe-a17b-d7da6233b183 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:05.915577 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7d3abdbf-22c3-42fe-a17b-d7da6233b183 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:05.919080 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:05.923393 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7d3abdbf-22c3-42fe-a17b-d7da6233b183 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.147886 Jun 23 22:49:05.923955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 261/509] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:05 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:06.349624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d1b4ddb0-5802-49c5-9a4a-279ee47a58ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:06.349624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d1b4ddb0-5802-49c5-9a4a-279ee47a58ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:06.354285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d1b4ddb0-5802-49c5-9a4a-279ee47a58ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:06.354725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d1b4ddb0-5802-49c5-9a4a-279ee47a58ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:06.355470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d1b4ddb0-5802-49c5-9a4a-279ee47a58ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:06.355898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d1b4ddb0-5802-49c5-9a4a-279ee47a58ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:06.481311 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d1b4ddb0-5802-49c5-9a4a-279ee47a58ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:06.488846 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d1b4ddb0-5802-49c5-9a4a-279ee47a58ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1680 microversion: 2.1 time: 0.145588 Jun 23 22:49:06.489644 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 249/510] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:06 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:06.765164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:06.765766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:06.773271 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:06.773715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:06.774962 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:06.775390 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:06.916530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:06.928838 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:06.930824 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:06.932294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-46d7aa88-5f7c-42b0-8ea3-979757acaa35 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.171093 Jun 23 22:49:06.933056 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 262/511] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:06 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:06.943449 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c7b04cd0-49e7-4db2-b6bd-fec62d2693a0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:06.944661 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c7b04cd0-49e7-4db2-b6bd-fec62d2693a0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:06.951254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7b04cd0-49e7-4db2-b6bd-fec62d2693a0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:06.951708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7b04cd0-49e7-4db2-b6bd-fec62d2693a0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:06.952474 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7b04cd0-49e7-4db2-b6bd-fec62d2693a0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:06.952933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c7b04cd0-49e7-4db2-b6bd-fec62d2693a0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:07.224560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c7b04cd0-49e7-4db2-b6bd-fec62d2693a0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:07.232063 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c7b04cd0-49e7-4db2-b6bd-fec62d2693a0 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.292492 Jun 23 22:49:07.232646 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 250/512] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:06 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:07.507423 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-36cfcb75-0e67-4ee6-bfbd-8a87c7fa14ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:07.510770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-36cfcb75-0e67-4ee6-bfbd-8a87c7fa14ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:07.514923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36cfcb75-0e67-4ee6-bfbd-8a87c7fa14ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:07.515391 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36cfcb75-0e67-4ee6-bfbd-8a87c7fa14ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:07.516125 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36cfcb75-0e67-4ee6-bfbd-8a87c7fa14ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:07.516561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36cfcb75-0e67-4ee6-bfbd-8a87c7fa14ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:07.585239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-36cfcb75-0e67-4ee6-bfbd-8a87c7fa14ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:07.593831 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-36cfcb75-0e67-4ee6-bfbd-8a87c7fa14ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1612 microversion: 2.1 time: 0.090191 Jun 23 22:49:07.594615 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 263/513] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:07 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1612 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:07.829849 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-71df2151-be5d-40b5-ba40-70ea28f93732 req-2395a773-2520-41f5-a0ac-0e515e406935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63c92940-b145-488a-9b8d-8c500cec9f96", "name": "network-vif-deleted", "tag": "94f7e1f5-be8a-4ca0-9aea-4b9afcae2d71"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:07.842989 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-71df2151-be5d-40b5-ba40-70ea28f93732 req-2395a773-2520-41f5-a0ac-0e515e406935 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:07.847742 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-71df2151-be5d-40b5-ba40-70ea28f93732 req-2395a773-2520-41f5-a0ac-0e515e406935 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:07.855573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-71df2151-be5d-40b5-ba40-70ea28f93732 req-2395a773-2520-41f5-a0ac-0e515e406935 service nova] Creating event network-vif-deleted:94f7e1f5-be8a-4ca0-9aea-4b9afcae2d71 for instance 63c92940-b145-488a-9b8d-8c500cec9f96 on hv-cinder-81322 Jun 23 22:49:07.860903 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-71df2151-be5d-40b5-ba40-70ea28f93732 req-2395a773-2520-41f5-a0ac-0e515e406935 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034650 Jun 23 22:49:07.862085 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 251/514] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:07.951944 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:07.953253 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:07.960933 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:07.961400 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:07.963075 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:07.963678 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.118189 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:08.130350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:08.132023 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:08.133335 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-47f7bba6-33de-47b7-b4bb-b49ddcd72a85 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.185626 Jun 23 22:49:08.144784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 264/515] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:07 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:08.250410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5beb59c1-f861-40e4-8a96-c511e1e9d3e3 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:08.258081 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5beb59c1-f861-40e4-8a96-c511e1e9d3e3 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:08.258081 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5beb59c1-f861-40e4-8a96-c511e1e9d3e3 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:08.259244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5beb59c1-f861-40e4-8a96-c511e1e9d3e3 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.260550 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5beb59c1-f861-40e4-8a96-c511e1e9d3e3 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:08.261024 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5beb59c1-f861-40e4-8a96-c511e1e9d3e3 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.330766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5b156eb1-5d2e-4c00-8f58-570c9d23c3ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa45e85a-209e-4b36-a603-ef27b2585598"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:08.332251 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5b156eb1-5d2e-4c00-8f58-570c9d23c3ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:08.339011 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5b156eb1-5d2e-4c00-8f58-570c9d23c3ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:08.339777 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5b156eb1-5d2e-4c00-8f58-570c9d23c3ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.340801 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5b156eb1-5d2e-4c00-8f58-570c9d23c3ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:08.341457 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5b156eb1-5d2e-4c00-8f58-570c9d23c3ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.408535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5beb59c1-f861-40e4-8a96-c511e1e9d3e3 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:08.416899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5beb59c1-f861-40e4-8a96-c511e1e9d3e3 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.170956 Jun 23 22:49:08.418311 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 252/516] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:08 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:08.602130 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-56bb346f-9c78-42d0-97bf-6dda4bbd1c1f req-493bf331-030e-46b4-94bf-a625690b6b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286fefab-3729-4c09-a3be-0af864c6de65", "name": "network-vif-plugged", "status": "completed", "tag": "b2734dfe-80ab-464a-85a5-81204d7db18e"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:08.613872 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-56bb346f-9c78-42d0-97bf-6dda4bbd1c1f req-493bf331-030e-46b4-94bf-a625690b6b35 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:08.614797 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-56bb346f-9c78-42d0-97bf-6dda4bbd1c1f req-493bf331-030e-46b4-94bf-a625690b6b35 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.628180 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-56bb346f-9c78-42d0-97bf-6dda4bbd1c1f req-493bf331-030e-46b4-94bf-a625690b6b35 service nova] Creating event network-vif-plugged:b2734dfe-80ab-464a-85a5-81204d7db18e for instance 286fefab-3729-4c09-a3be-0af864c6de65 on hv-cinder-81322 Jun 23 22:49:08.633596 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-56bb346f-9c78-42d0-97bf-6dda4bbd1c1f req-493bf331-030e-46b4-94bf-a625690b6b35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Jun 23 22:49:08.634189 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 253/517] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:49:08.640972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:08.641942 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:08.665785 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:08.666696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.668304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:08.668941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.708104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:08.708834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:08.709620 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lazy-loading 'fault' on Instance uuid 63c92940-b145-488a-9b8d-8c500cec9f96 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:08.785247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:08.793790 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-68ca92b1-aaef-4d5d-a2a7-2d407644f3c9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 200 len: 1331 microversion: 2.1 time: 0.157793 Jun 23 22:49:08.794625 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 254/518] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:08 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 1331 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:09.152558 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:09.153321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:09.163949 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:09.164400 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:09.165928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:09.166355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:09.184962 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5b156eb1-5d2e-4c00-8f58-570c9d23c3ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857811 Jun 23 22:49:09.189666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 265/519] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:49:08 2022] POST /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments => generated 194 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:09.433589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2d52073e-27ae-4655-b8a2-7cb39b902e76 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:09.434112 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2d52073e-27ae-4655-b8a2-7cb39b902e76 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:09.442950 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d52073e-27ae-4655-b8a2-7cb39b902e76 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:09.443445 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d52073e-27ae-4655-b8a2-7cb39b902e76 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:09.444157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d52073e-27ae-4655-b8a2-7cb39b902e76 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:09.444760 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d52073e-27ae-4655-b8a2-7cb39b902e76 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:09.480070 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:09.496759 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:09.498511 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:09.499907 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e5054b3e-af71-4689-ba7c-1f0e7cc8b147 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.352252 Jun 23 22:49:09.500609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 255/520] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:09 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:09.584693 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2d52073e-27ae-4655-b8a2-7cb39b902e76 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:09.592823 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2d52073e-27ae-4655-b8a2-7cb39b902e76 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.163499 Jun 23 22:49:09.593384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 266/521] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:09 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:09.811965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:09.812595 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:09.818894 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:09.819344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:09.820184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:09.820727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:09.834649 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 HTTP/1.1 Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:49:09.836278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:49:09.838353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '63c92940-b145-488a-9b8d-8c500cec9f96'} Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:49:09.839244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:49:09.840701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:09.841979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:49:09.841979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4fc7392d-33a9-4caf-8ea4-09ab1c42dd1f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 404 len: 111 microversion: 2.1 time: 0.030255 Jun 23 22:49:09.841979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 256/522] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:09 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:49:09.847126 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9e287a32-5550-4330-9d67-e3f2a4b51d60 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '.version_select at 0x7fbbca3fc430>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:09.921496 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9e287a32-5550-4330-9d67-e3f2a4b51d60 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683318110" status: 202 len: 0 microversion: 2.1 time: 0.078029 Jun 23 22:49:09.922069 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 267/523] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 23 22:49:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683318110 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:49:10.519152 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:10.519693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:10.526089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:10.526533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:10.527276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:10.527707 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:10.610077 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cf6a68f8-80b8-45c6-b192-5bb05b29f344 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:10.610905 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cf6a68f8-80b8-45c6-b192-5bb05b29f344 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:10.620745 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cf6a68f8-80b8-45c6-b192-5bb05b29f344 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:10.621543 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cf6a68f8-80b8-45c6-b192-5bb05b29f344 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:10.622535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cf6a68f8-80b8-45c6-b192-5bb05b29f344 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:10.623197 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cf6a68f8-80b8-45c6-b192-5bb05b29f344 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:10.664829 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:10.673656 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:10.675165 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:10.677565 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e9f186da-a56b-4fd9-bbef-05cbc01c73c4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.161574 Jun 23 22:49:10.678128 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 257/524] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:10 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:10.688835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-1a28812c-7b6a-4dfb-a8db-66cca488e5dc req-f2bb74c8-5b90-4c4e-9d6e-4da3d884a60e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92576fd0-4632-4e5b-9487-90d4da5a1e04", "name": "network-vif-plugged", "status": "completed", "tag": "0af3849b-3eda-452d-a709-52a282dbce71"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:10.691585 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-1a28812c-7b6a-4dfb-a8db-66cca488e5dc req-f2bb74c8-5b90-4c4e-9d6e-4da3d884a60e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:10.692022 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-1a28812c-7b6a-4dfb-a8db-66cca488e5dc req-f2bb74c8-5b90-4c4e-9d6e-4da3d884a60e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:10.703553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-1a28812c-7b6a-4dfb-a8db-66cca488e5dc req-f2bb74c8-5b90-4c4e-9d6e-4da3d884a60e service nova] Creating event network-vif-plugged:0af3849b-3eda-452d-a709-52a282dbce71 for instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 on hv-cinder-81322 Jun 23 22:49:10.710669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-1a28812c-7b6a-4dfb-a8db-66cca488e5dc req-f2bb74c8-5b90-4c4e-9d6e-4da3d884a60e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031360 Jun 23 22:49:10.711469 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 258/525] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:10.762734 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-41743b47-8f1c-4743-8106-f24834fe8d5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:10.763320 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-41743b47-8f1c-4743-8106-f24834fe8d5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:10.769599 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41743b47-8f1c-4743-8106-f24834fe8d5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:10.769986 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41743b47-8f1c-4743-8106-f24834fe8d5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:10.770747 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41743b47-8f1c-4743-8106-f24834fe8d5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:10.771187 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41743b47-8f1c-4743-8106-f24834fe8d5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:10.776238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cf6a68f8-80b8-45c6-b192-5bb05b29f344 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:10.783883 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cf6a68f8-80b8-45c6-b192-5bb05b29f344 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.178411 Jun 23 22:49:10.784525 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 268/526] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:10 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:10.893784 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-41743b47-8f1c-4743-8106-f24834fe8d5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lazy-loading 'services' on Instance uuid e8042229-5eb7-4d72-a37f-d3d15dff51b8 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:11.160646 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-41743b47-8f1c-4743-8106-f24834fe8d5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments/92ce0f73-e10b-4f18-9997-9511d87d2b34" status: 202 len: 0 microversion: 2.1 time: 0.402477 Jun 23 22:49:11.161233 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 259/527] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:49:10 2022] DELETE /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments/92ce0f73-e10b-4f18-9997-9511d87d2b34 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 22:49:11.170146 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c02ccdaf-9cf1-427d-a12a-2dc1a8d4c0f3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:11.171075 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c02ccdaf-9cf1-427d-a12a-2dc1a8d4c0f3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:11.177599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c02ccdaf-9cf1-427d-a12a-2dc1a8d4c0f3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:11.178054 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c02ccdaf-9cf1-427d-a12a-2dc1a8d4c0f3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:11.178808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c02ccdaf-9cf1-427d-a12a-2dc1a8d4c0f3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:11.179244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c02ccdaf-9cf1-427d-a12a-2dc1a8d4c0f3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:11.208488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c02ccdaf-9cf1-427d-a12a-2dc1a8d4c0f3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042259 Jun 23 22:49:11.209295 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 269/528] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:49:11 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:11.697471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:11.698180 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:11.705254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:11.705714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:11.706479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:11.707037 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:11.801099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0a033eb1-2e08-4d86-8848-dacc8f2a1728 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:11.802301 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0a033eb1-2e08-4d86-8848-dacc8f2a1728 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:11.809691 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a033eb1-2e08-4d86-8848-dacc8f2a1728 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:11.810206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a033eb1-2e08-4d86-8848-dacc8f2a1728 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:11.810973 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a033eb1-2e08-4d86-8848-dacc8f2a1728 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:11.811400 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a033eb1-2e08-4d86-8848-dacc8f2a1728 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:11.842380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:11.851170 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:11.853152 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:11.854499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5df63d5c-641e-4d0b-9f44-71f17ee8af3d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1808 microversion: 2.20 time: 0.161912 Jun 23 22:49:11.855054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 260/529] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:11 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:11.943269 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0a033eb1-2e08-4d86-8848-dacc8f2a1728 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:11.950880 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0a033eb1-2e08-4d86-8848-dacc8f2a1728 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.153520 Jun 23 22:49:11.951429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 270/530] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:11 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:12.220723 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4d1f58b8-c2a4-4231-a72b-bd42fdcffde4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:12.221681 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4d1f58b8-c2a4-4231-a72b-bd42fdcffde4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:12.228472 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d1f58b8-c2a4-4231-a72b-bd42fdcffde4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:12.228974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d1f58b8-c2a4-4231-a72b-bd42fdcffde4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:12.229735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d1f58b8-c2a4-4231-a72b-bd42fdcffde4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:12.230169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d1f58b8-c2a4-4231-a72b-bd42fdcffde4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:12.259282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4d1f58b8-c2a4-4231-a72b-bd42fdcffde4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Jun 23 22:49:12.259840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 261/531] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:49:12 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:12.873495 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:12.874099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:12.880535 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:12.881013 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:12.881760 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:12.882189 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:12.967511 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-09025939-ca9b-4ce3-b450-8fc407c064b4 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:12.968116 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-09025939-ca9b-4ce3-b450-8fc407c064b4 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:12.974738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09025939-ca9b-4ce3-b450-8fc407c064b4 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:12.975184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09025939-ca9b-4ce3-b450-8fc407c064b4 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:12.975944 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09025939-ca9b-4ce3-b450-8fc407c064b4 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:12.976379 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-09025939-ca9b-4ce3-b450-8fc407c064b4 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:13.014646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:13.023595 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:13.025932 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:13.027575 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-46d86eed-061d-4a3a-a630-39221e9dafa5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1795 microversion: 2.20 time: 0.158004 Jun 23 22:49:13.028309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 271/532] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:12 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1795 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:13.109718 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-09025939-ca9b-4ce3-b450-8fc407c064b4 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:13.118323 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-09025939-ca9b-4ce3-b450-8fc407c064b4 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1318 microversion: 2.1 time: 0.154530 Jun 23 22:49:13.118893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 262/533] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:12 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:13.271150 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c5088346-822e-4708-a494-a6b313ef279d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:13.272215 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c5088346-822e-4708-a494-a6b313ef279d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:13.279037 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c5088346-822e-4708-a494-a6b313ef279d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:13.281132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c5088346-822e-4708-a494-a6b313ef279d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:13.281132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c5088346-822e-4708-a494-a6b313ef279d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:13.281132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c5088346-822e-4708-a494-a6b313ef279d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:13.311441 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c5088346-822e-4708-a494-a6b313ef279d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044448 Jun 23 22:49:13.311997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 272/534] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:49:13 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:14.134895 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-63dc3844-8e7c-4645-99ee-499ddd0cdc58 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:14.135518 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-63dc3844-8e7c-4645-99ee-499ddd0cdc58 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:14.142119 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63dc3844-8e7c-4645-99ee-499ddd0cdc58 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:14.142567 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63dc3844-8e7c-4645-99ee-499ddd0cdc58 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:14.143320 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63dc3844-8e7c-4645-99ee-499ddd0cdc58 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:14.143752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-63dc3844-8e7c-4645-99ee-499ddd0cdc58 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:14.270435 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-63dc3844-8e7c-4645-99ee-499ddd0cdc58 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:14.278720 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-63dc3844-8e7c-4645-99ee-499ddd0cdc58 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1507 microversion: 2.1 time: 0.147938 Jun 23 22:49:14.279260 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 263/535] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:14 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:14.295109 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-237349d1-f813-4b42-9ba3-b8176d771513 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7062eb29-fb9d-4abf-8474-7357541720a0", "device": "/dev/sdb"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:14.296726 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-237349d1-f813-4b42-9ba3-b8176d771513 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:14.303063 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-237349d1-f813-4b42-9ba3-b8176d771513 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:14.303501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-237349d1-f813-4b42-9ba3-b8176d771513 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:14.304244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-237349d1-f813-4b42-9ba3-b8176d771513 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:14.304699 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-237349d1-f813-4b42-9ba3-b8176d771513 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:14.323276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5c24475a-2ce5-4d26-8e31-7e9ee73f9256 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:14.324230 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c24475a-2ce5-4d26-8e31-7e9ee73f9256 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:14.330097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c24475a-2ce5-4d26-8e31-7e9ee73f9256 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:14.330542 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c24475a-2ce5-4d26-8e31-7e9ee73f9256 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:14.331300 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c24475a-2ce5-4d26-8e31-7e9ee73f9256 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:14.331720 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c24475a-2ce5-4d26-8e31-7e9ee73f9256 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:14.360831 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5c24475a-2ce5-4d26-8e31-7e9ee73f9256 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041824 Jun 23 22:49:14.361399 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 264/536] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:49:14 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:49:14.982050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-237349d1-f813-4b42-9ba3-b8176d771513 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "POST /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.690524 Jun 23 22:49:14.982661 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 273/537] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:49:14 2022] POST /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04/os-volume_attachments => generated 194 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:15.372989 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-86372e0b-8ea8-4428-90b3-bddf7c8c242c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:15.373826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86372e0b-8ea8-4428-90b3-bddf7c8c242c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:15.380258 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86372e0b-8ea8-4428-90b3-bddf7c8c242c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:15.380736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86372e0b-8ea8-4428-90b3-bddf7c8c242c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:15.381482 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86372e0b-8ea8-4428-90b3-bddf7c8c242c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:15.381910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86372e0b-8ea8-4428-90b3-bddf7c8c242c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:15.385912 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:15.410742 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-86372e0b-8ea8-4428-90b3-bddf7c8c242c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041782 Jun 23 22:49:15.411275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 265/538] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:49:15 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:16.423537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-534a759c-4be1-40cd-906f-4451b2c04dce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:16.424533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-534a759c-4be1-40cd-906f-4451b2c04dce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:16.426927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:16.432531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-534a759c-4be1-40cd-906f-4451b2c04dce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:16.433117 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-534a759c-4be1-40cd-906f-4451b2c04dce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:16.434144 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-534a759c-4be1-40cd-906f-4451b2c04dce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:16.434582 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-534a759c-4be1-40cd-906f-4451b2c04dce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:16.463577 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-534a759c-4be1-40cd-906f-4451b2c04dce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Jun 23 22:49:16.464136 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 274/539] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:49:16 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:16.746006 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-22434105-b8e6-4e0c-99b5-298f854300f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:16.746938 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-22434105-b8e6-4e0c-99b5-298f854300f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:16.753818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22434105-b8e6-4e0c-99b5-298f854300f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:16.754283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22434105-b8e6-4e0c-99b5-298f854300f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:16.759865 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22434105-b8e6-4e0c-99b5-298f854300f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:16.759865 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22434105-b8e6-4e0c-99b5-298f854300f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:16.778236 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-22434105-b8e6-4e0c-99b5-298f854300f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lazy-loading 'flavor' on Instance uuid 9dafd3dc-6a6c-4a96-854d-e380a187a72b {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:17.096653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-22434105-b8e6-4e0c-99b5-298f854300f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/action" status: 200 len: 32 microversion: 2.1 time: 0.355657 Jun 23 22:49:17.097262 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 266/540] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:49:16 2022] POST /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/action => generated 32 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:49:17.106746 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-aa191a9b-bd90-425a-a285-931d9d29fb5a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:17.107357 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-aa191a9b-bd90-425a-a285-931d9d29fb5a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:17.114822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-aa191a9b-bd90-425a-a285-931d9d29fb5a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:17.115272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-aa191a9b-bd90-425a-a285-931d9d29fb5a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:17.116029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-aa191a9b-bd90-425a-a285-931d9d29fb5a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:17.116468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-aa191a9b-bd90-425a-a285-931d9d29fb5a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:17.251507 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-aa191a9b-bd90-425a-a285-931d9d29fb5a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:17.259402 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-aa191a9b-bd90-425a-a285-931d9d29fb5a tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.157050 Jun 23 22:49:17.259957 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 275/541] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:17 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:17.475049 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-aae16b4b-9629-4a08-98d5-402896164cc5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:17.476175 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-aae16b4b-9629-4a08-98d5-402896164cc5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:17.482353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aae16b4b-9629-4a08-98d5-402896164cc5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:17.482802 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aae16b4b-9629-4a08-98d5-402896164cc5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:17.483554 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aae16b4b-9629-4a08-98d5-402896164cc5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:17.483986 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-aae16b4b-9629-4a08-98d5-402896164cc5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:17.514315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-aae16b4b-9629-4a08-98d5-402896164cc5 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Jun 23 22:49:17.514872 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 267/542] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:49:17 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:18.277801 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5e22f6ad-771c-4a4e-9083-c5df39ff7579 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:18.278428 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5e22f6ad-771c-4a4e-9083-c5df39ff7579 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:18.285251 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5e22f6ad-771c-4a4e-9083-c5df39ff7579 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:18.285719 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5e22f6ad-771c-4a4e-9083-c5df39ff7579 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:18.286510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5e22f6ad-771c-4a4e-9083-c5df39ff7579 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:18.286950 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5e22f6ad-771c-4a4e-9083-c5df39ff7579 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:18.419239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5e22f6ad-771c-4a4e-9083-c5df39ff7579 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:18.422680 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:18.427528 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5e22f6ad-771c-4a4e-9083-c5df39ff7579 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.153919 Jun 23 22:49:18.428095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 276/543] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:18 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:18.526221 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e659a5c8-91bc-4b02-b6cb-d690f2cc4233 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:18.527153 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e659a5c8-91bc-4b02-b6cb-d690f2cc4233 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:18.533725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e659a5c8-91bc-4b02-b6cb-d690f2cc4233 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:18.534114 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e659a5c8-91bc-4b02-b6cb-d690f2cc4233 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:18.534866 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e659a5c8-91bc-4b02-b6cb-d690f2cc4233 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:18.535294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e659a5c8-91bc-4b02-b6cb-d690f2cc4233 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:18.564201 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e659a5c8-91bc-4b02-b6cb-d690f2cc4233 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042115 Jun 23 22:49:18.564787 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 268/544] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:49:18 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:49:18.625925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fa790c71-7b0b-4c71-a3cf-b35ca2044c00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:18.625925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fa790c71-7b0b-4c71-a3cf-b35ca2044c00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:18.630178 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fa790c71-7b0b-4c71-a3cf-b35ca2044c00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:18.630629 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fa790c71-7b0b-4c71-a3cf-b35ca2044c00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:18.631384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fa790c71-7b0b-4c71-a3cf-b35ca2044c00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:18.631822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fa790c71-7b0b-4c71-a3cf-b35ca2044c00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:18.656318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fa790c71-7b0b-4c71-a3cf-b35ca2044c00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:49:18.955198 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fa790c71-7b0b-4c71-a3cf-b35ca2044c00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 204 len: 0 microversion: 2.1 time: 0.336698 Jun 23 22:49:18.955797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 277/545] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:49:18 2022] DELETE /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:49:18.965037 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6a2a98d9-ae11-42c9-b6d1-ac6596095243 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:18.966332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6a2a98d9-ae11-42c9-b6d1-ac6596095243 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:18.971673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a2a98d9-ae11-42c9-b6d1-ac6596095243 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:18.972116 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a2a98d9-ae11-42c9-b6d1-ac6596095243 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:18.972885 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a2a98d9-ae11-42c9-b6d1-ac6596095243 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:18.973313 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a2a98d9-ae11-42c9-b6d1-ac6596095243 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:19.106642 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6a2a98d9-ae11-42c9-b6d1-ac6596095243 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:19.114369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6a2a98d9-ae11-42c9-b6d1-ac6596095243 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1680 microversion: 2.1 time: 0.153984 Jun 23 22:49:19.114926 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 269/546] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:18 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:19.445627 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4c056980-be4d-4019-9394-53cb6e2eb521 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:19.446350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4c056980-be4d-4019-9394-53cb6e2eb521 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:19.453405 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c056980-be4d-4019-9394-53cb6e2eb521 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:19.453858 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c056980-be4d-4019-9394-53cb6e2eb521 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:19.454611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c056980-be4d-4019-9394-53cb6e2eb521 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:19.455044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c056980-be4d-4019-9394-53cb6e2eb521 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:19.583427 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4c056980-be4d-4019-9394-53cb6e2eb521 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:19.592025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4c056980-be4d-4019-9394-53cb6e2eb521 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.150619 Jun 23 22:49:19.592600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 278/547] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:19 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:20.131306 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-506a06c4-19eb-40a8-b172-e138912918e0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:20.131916 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-506a06c4-19eb-40a8-b172-e138912918e0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:20.134357 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:20.139626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-506a06c4-19eb-40a8-b172-e138912918e0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:20.140074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-506a06c4-19eb-40a8-b172-e138912918e0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:20.140869 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-506a06c4-19eb-40a8-b172-e138912918e0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:20.141303 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-506a06c4-19eb-40a8-b172-e138912918e0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:20.267971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-506a06c4-19eb-40a8-b172-e138912918e0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:20.275550 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-506a06c4-19eb-40a8-b172-e138912918e0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1680 microversion: 2.1 time: 0.147990 Jun 23 22:49:20.276252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 270/548] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:20 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:20.609807 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9c9e4691-fc46-4adc-822c-29919b847d98 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:20.610413 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9c9e4691-fc46-4adc-822c-29919b847d98 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:20.617386 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9c9e4691-fc46-4adc-822c-29919b847d98 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:20.617836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9c9e4691-fc46-4adc-822c-29919b847d98 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:20.618596 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9c9e4691-fc46-4adc-822c-29919b847d98 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:20.619036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9c9e4691-fc46-4adc-822c-29919b847d98 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:20.751822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9c9e4691-fc46-4adc-822c-29919b847d98 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:20.759722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9c9e4691-fc46-4adc-822c-29919b847d98 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.153836 Jun 23 22:49:20.760303 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 279/549] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:20 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:21.292689 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c8344b48-0e70-4481-b174-9c2d72558056 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:21.293315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c8344b48-0e70-4481-b174-9c2d72558056 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:21.299600 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8344b48-0e70-4481-b174-9c2d72558056 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:21.300056 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8344b48-0e70-4481-b174-9c2d72558056 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:21.300841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8344b48-0e70-4481-b174-9c2d72558056 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:21.301275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c8344b48-0e70-4481-b174-9c2d72558056 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:21.626320 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c8344b48-0e70-4481-b174-9c2d72558056 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:21.633845 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c8344b48-0e70-4481-b174-9c2d72558056 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1680 microversion: 2.1 time: 0.345081 Jun 23 22:49:21.634413 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 271/550] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:21 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1680 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:21.777399 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c3da4f1d-5cc0-4d10-b6cb-24edecc06a92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:21.778104 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c3da4f1d-5cc0-4d10-b6cb-24edecc06a92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:21.784725 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c3da4f1d-5cc0-4d10-b6cb-24edecc06a92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:21.785405 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c3da4f1d-5cc0-4d10-b6cb-24edecc06a92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:21.786163 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c3da4f1d-5cc0-4d10-b6cb-24edecc06a92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:21.786757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c3da4f1d-5cc0-4d10-b6cb-24edecc06a92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:21.928862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c3da4f1d-5cc0-4d10-b6cb-24edecc06a92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:21.933080 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c3da4f1d-5cc0-4d10-b6cb-24edecc06a92 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.160141 Jun 23 22:49:21.933651 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 280/551] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:21 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:22.164189 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-eac1fb9f-aa86-4e67-b739-ad95f4c996b3 req-ca52e538-a2a8-463d-b1c5-8b406d12c863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8042229-5eb7-4d72-a37f-d3d15dff51b8", "name": "network-vif-deleted", "tag": "82d58367-4f7b-41b7-82c3-2460e09a1f13"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:22.172128 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-eac1fb9f-aa86-4e67-b739-ad95f4c996b3 req-ca52e538-a2a8-463d-b1c5-8b406d12c863 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:22.172488 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-eac1fb9f-aa86-4e67-b739-ad95f4c996b3 req-ca52e538-a2a8-463d-b1c5-8b406d12c863 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:22.185954 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-eac1fb9f-aa86-4e67-b739-ad95f4c996b3 req-ca52e538-a2a8-463d-b1c5-8b406d12c863 service nova] Creating event network-vif-deleted:82d58367-4f7b-41b7-82c3-2460e09a1f13 for instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 on hv-cinder-81322 Jun 23 22:49:22.191022 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-eac1fb9f-aa86-4e67-b739-ad95f4c996b3 req-ca52e538-a2a8-463d-b1c5-8b406d12c863 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 Jun 23 22:49:22.191507 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 272/552] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:22.650754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:22.651371 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:22.657611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:22.658061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:22.658832 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:22.659269 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:22.690823 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:22.691267 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:22.691739 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lazy-loading 'fault' on Instance uuid e8042229-5eb7-4d72-a37f-d3d15dff51b8 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:22.731570 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:22.739253 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-dd19cab0-9d60-4c78-a784-d53b9d5f852a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 200 len: 1330 microversion: 2.1 time: 0.092297 Jun 23 22:49:22.739818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 281/553] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:22 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:22.951351 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-feb88145-db72-4426-a354-2b6525e18d39 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:22.952827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-feb88145-db72-4426-a354-2b6525e18d39 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:22.959310 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-feb88145-db72-4426-a354-2b6525e18d39 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:22.959818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-feb88145-db72-4426-a354-2b6525e18d39 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:22.960556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-feb88145-db72-4426-a354-2b6525e18d39 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:22.961027 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-feb88145-db72-4426-a354-2b6525e18d39 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:23.099355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-feb88145-db72-4426-a354-2b6525e18d39 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:23.108629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-feb88145-db72-4426-a354-2b6525e18d39 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.161869 Jun 23 22:49:23.109207 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 273/554] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:22 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:23.757305 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:23.757919 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:23.764660 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:23.765114 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:23.765867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:23.766303 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:23.779991 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 HTTP/1.1 Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:49:23.781605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:49:23.783079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': 'e8042229-5eb7-4d72-a37f-d3d15dff51b8'} Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:49:23.783925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:49:23.785365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:23.786678 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:49:23.786678 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-95db17cd-1f14-4cf8-bcee-e8dcb6458a75 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 404 len: 111 microversion: 2.1 time: 0.029602 Jun 23 22:49:23.786678 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 282/555] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:23 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:49:23.792377 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fe75ab38-3d20-4d63-ba0a-1c3a70de865f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '.version_select at 0x7fbbcab00040>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:23.882072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fe75ab38-3d20-4d63-ba0a-1c3a70de865f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-78893719" status: 202 len: 0 microversion: 2.1 time: 0.094185 Jun 23 22:49:23.882647 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 274/556] 10.222.0.33 () {58 vars in 1214 bytes} [Thu Jun 23 22:49:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-78893719 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:49:24.126515 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8470f737-7a5d-4622-abee-7bc46a89029d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:24.127125 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8470f737-7a5d-4622-abee-7bc46a89029d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:24.133398 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8470f737-7a5d-4622-abee-7bc46a89029d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:24.133845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8470f737-7a5d-4622-abee-7bc46a89029d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:24.135328 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8470f737-7a5d-4622-abee-7bc46a89029d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:24.135775 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8470f737-7a5d-4622-abee-7bc46a89029d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:24.268533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8470f737-7a5d-4622-abee-7bc46a89029d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:24.277007 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8470f737-7a5d-4622-abee-7bc46a89029d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.154425 Jun 23 22:49:24.277571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 283/557] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:24 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:24.585657 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7978d0cd-3b1d-41a6-b5a7-da06f2baeabd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: .version_select at 0x7fbbcaa8e820>, body: {"keypair": {"name": "tempest-keypair-1753477397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7xHeyRjRNyzf1IyluO7zJhUR19owOco/1wKi8gjUblWFxWL1BdoSJtKWdXP3hpLFPbCO/9MWUPYw+S7KtjF646AhYFbHJb2dlkv1SVRNPg/d2RwW01QNb+8evoDUHJSg=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:24.608947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-7978d0cd-3b1d-41a6-b5a7-da06f2baeabd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:49:24.613017 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-7978d0cd-3b1d-41a6-b5a7-da06f2baeabd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for user 1d7e431402f8433fb7565f69103485ce and project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:49:24.709572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7978d0cd-3b1d-41a6-b5a7-da06f2baeabd tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.128535 Jun 23 22:49:24.710177 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 275/558] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:49:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:25.294644 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1d139dea-8833-48fa-bae0-371a7ac3ff05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:25.295251 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1d139dea-8833-48fa-bae0-371a7ac3ff05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:25.302234 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1d139dea-8833-48fa-bae0-371a7ac3ff05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:25.302686 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1d139dea-8833-48fa-bae0-371a7ac3ff05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:25.303468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1d139dea-8833-48fa-bae0-371a7ac3ff05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:25.303901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1d139dea-8833-48fa-bae0-371a7ac3ff05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:25.436089 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1d139dea-8833-48fa-bae0-371a7ac3ff05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:25.442371 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1d139dea-8833-48fa-bae0-371a7ac3ff05 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.151504 Jun 23 22:49:25.443147 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 284/559] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:25 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:26.460019 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-96d79b0d-43f7-4a83-ba73-c83c2e7ee9dc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:26.460830 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-96d79b0d-43f7-4a83-ba73-c83c2e7ee9dc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:26.469658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96d79b0d-43f7-4a83-ba73-c83c2e7ee9dc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:26.470108 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96d79b0d-43f7-4a83-ba73-c83c2e7ee9dc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:26.470866 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96d79b0d-43f7-4a83-ba73-c83c2e7ee9dc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:26.471304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-96d79b0d-43f7-4a83-ba73-c83c2e7ee9dc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:26.648682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-96d79b0d-43f7-4a83-ba73-c83c2e7ee9dc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:26.656852 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-96d79b0d-43f7-4a83-ba73-c83c2e7ee9dc tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.201419 Jun 23 22:49:26.657414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 276/560] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:26 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:26.807619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1400146401", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c28b5ed-da0d-4ee9-8621-fe10ec1946bf"}], "security_groups": [{"name": "tempest-securitygroup--1973357622"}], "key_name": "tempest-keypair-1753477397", "user_data": "}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:26.908302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.network.neutron [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] validate_networks() for [('3c28b5ed-da0d-4ee9-8621-fe10ec1946bf', None, None, None, None, None)] {{(pid=124724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:49:27.280858 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Flavor limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:49:27.281280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Image limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:49:27.281762 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Flavor pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:49:27.282144 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Image pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:49:27.282547 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:49:27.292025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:27.292483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:27.293380 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:27.293807 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:27.310066 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:49:27.314041 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for user 1d7e431402f8433fb7565f69103485ce and project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:49:27.324819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Going to run 1 instances... {{(pid=124724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:49:27.327090 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:49:27.482230 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-311fe167-cde6-47e8-82a8-cb5efab83eb8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.679355 Jun 23 22:49:27.482889 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 285/561] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:49:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:49:27.493121 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cdf37c5c-da3d-405d-b72b-2994a3e3cbb3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:27.493729 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cdf37c5c-da3d-405d-b72b-2994a3e3cbb3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:27.545842 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cdf37c5c-da3d-405d-b72b-2994a3e3cbb3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:27.552559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cdf37c5c-da3d-405d-b72b-2994a3e3cbb3 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1242 microversion: 2.1 time: 0.063258 Jun 23 22:49:27.553353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 277/562] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:27 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:27.673738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f8ed2f3d-9e81-45b9-bb0e-7922cb414231 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:27.674346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f8ed2f3d-9e81-45b9-bb0e-7922cb414231 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:27.681194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f8ed2f3d-9e81-45b9-bb0e-7922cb414231 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:27.681671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f8ed2f3d-9e81-45b9-bb0e-7922cb414231 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:27.682443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f8ed2f3d-9e81-45b9-bb0e-7922cb414231 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:27.682954 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f8ed2f3d-9e81-45b9-bb0e-7922cb414231 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:27.816186 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f8ed2f3d-9e81-45b9-bb0e-7922cb414231 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:27.822478 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f8ed2f3d-9e81-45b9-bb0e-7922cb414231 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.152172 Jun 23 22:49:27.835317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 286/563] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:27 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:28.568623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7c40ee6b-c6f9-4c91-b46c-7f999b77266a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:28.569229 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7c40ee6b-c6f9-4c91-b46c-7f999b77266a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:28.576483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7c40ee6b-c6f9-4c91-b46c-7f999b77266a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:28.576947 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7c40ee6b-c6f9-4c91-b46c-7f999b77266a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:28.577688 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7c40ee6b-c6f9-4c91-b46c-7f999b77266a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:28.578116 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7c40ee6b-c6f9-4c91-b46c-7f999b77266a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:28.640990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7c40ee6b-c6f9-4c91-b46c-7f999b77266a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:28.648316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7c40ee6b-c6f9-4c91-b46c-7f999b77266a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1246 microversion: 2.1 time: 0.083538 Jun 23 22:49:28.648885 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 278/564] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:28 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:28.844076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2d7a79d8-6e40-472f-858b-e0b3920c5a8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:28.844704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2d7a79d8-6e40-472f-858b-e0b3920c5a8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:28.851230 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d7a79d8-6e40-472f-858b-e0b3920c5a8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:28.851676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d7a79d8-6e40-472f-858b-e0b3920c5a8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:28.852420 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d7a79d8-6e40-472f-858b-e0b3920c5a8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:28.852876 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d7a79d8-6e40-472f-858b-e0b3920c5a8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:28.984041 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2d7a79d8-6e40-472f-858b-e0b3920c5a8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:28.992312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2d7a79d8-6e40-472f-858b-e0b3920c5a8e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.151868 Jun 23 22:49:28.992724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 287/565] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:28 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:29.665200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6a4d0e8e-2e97-41d0-a4cd-0133b67e40f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:29.666343 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6a4d0e8e-2e97-41d0-a4cd-0133b67e40f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:29.673016 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a4d0e8e-2e97-41d0-a4cd-0133b67e40f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:29.673465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a4d0e8e-2e97-41d0-a4cd-0133b67e40f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:29.674224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a4d0e8e-2e97-41d0-a4cd-0133b67e40f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:29.674668 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6a4d0e8e-2e97-41d0-a4cd-0133b67e40f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:29.735759 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6a4d0e8e-2e97-41d0-a4cd-0133b67e40f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:29.743253 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6a4d0e8e-2e97-41d0-a4cd-0133b67e40f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1238 microversion: 2.1 time: 0.082047 Jun 23 22:49:29.743857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 279/566] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:29 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:30.008306 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-52e211bb-1869-4607-bf1b-7da53108a7ce tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:30.008936 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-52e211bb-1869-4607-bf1b-7da53108a7ce tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:30.016057 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-52e211bb-1869-4607-bf1b-7da53108a7ce tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:30.016506 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-52e211bb-1869-4607-bf1b-7da53108a7ce tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:30.017290 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-52e211bb-1869-4607-bf1b-7da53108a7ce tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:30.017722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-52e211bb-1869-4607-bf1b-7da53108a7ce tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:30.152442 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-52e211bb-1869-4607-bf1b-7da53108a7ce tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:30.160516 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-52e211bb-1869-4607-bf1b-7da53108a7ce tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.155980 Jun 23 22:49:30.161100 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 288/567] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:30 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:30.769932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-67a5df3e-f41b-4af0-acc0-f07532de9f1c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:30.770540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-67a5df3e-f41b-4af0-acc0-f07532de9f1c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:30.777839 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67a5df3e-f41b-4af0-acc0-f07532de9f1c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:30.778288 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67a5df3e-f41b-4af0-acc0-f07532de9f1c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:30.779200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67a5df3e-f41b-4af0-acc0-f07532de9f1c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:30.779638 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67a5df3e-f41b-4af0-acc0-f07532de9f1c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:30.871749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-67a5df3e-f41b-4af0-acc0-f07532de9f1c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:30.879293 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-67a5df3e-f41b-4af0-acc0-f07532de9f1c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1300 microversion: 2.1 time: 0.113941 Jun 23 22:49:30.880069 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 280/568] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:30 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:31.178269 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7e36f785-052d-4d8b-8a83-6c1de8861d9e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:31.180667 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7e36f785-052d-4d8b-8a83-6c1de8861d9e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:31.186467 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e36f785-052d-4d8b-8a83-6c1de8861d9e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:31.186949 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e36f785-052d-4d8b-8a83-6c1de8861d9e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:31.187679 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e36f785-052d-4d8b-8a83-6c1de8861d9e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:31.188109 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e36f785-052d-4d8b-8a83-6c1de8861d9e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:31.316359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7e36f785-052d-4d8b-8a83-6c1de8861d9e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:31.325030 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7e36f785-052d-4d8b-8a83-6c1de8861d9e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.150703 Jun 23 22:49:31.325593 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 289/569] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:31 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:31.896963 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5bb2e41a-8a4c-453f-b7f6-1f7836d139e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:31.897501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5bb2e41a-8a4c-453f-b7f6-1f7836d139e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:31.904785 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5bb2e41a-8a4c-453f-b7f6-1f7836d139e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:31.905233 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5bb2e41a-8a4c-453f-b7f6-1f7836d139e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:31.905976 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5bb2e41a-8a4c-453f-b7f6-1f7836d139e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:31.906403 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5bb2e41a-8a4c-453f-b7f6-1f7836d139e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:32.034718 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5bb2e41a-8a4c-453f-b7f6-1f7836d139e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:32.043544 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5bb2e41a-8a4c-453f-b7f6-1f7836d139e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.150421 Jun 23 22:49:32.044101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 281/570] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:31 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:32.342608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-57b2a50c-6fb5-4393-b2cf-590dab09b5f4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:32.343207 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-57b2a50c-6fb5-4393-b2cf-590dab09b5f4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:32.349703 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-57b2a50c-6fb5-4393-b2cf-590dab09b5f4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:32.350150 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-57b2a50c-6fb5-4393-b2cf-590dab09b5f4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:32.350893 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-57b2a50c-6fb5-4393-b2cf-590dab09b5f4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:32.351322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-57b2a50c-6fb5-4393-b2cf-590dab09b5f4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:32.478635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-57b2a50c-6fb5-4393-b2cf-590dab09b5f4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:32.486513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-57b2a50c-6fb5-4393-b2cf-590dab09b5f4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.147719 Jun 23 22:49:32.487076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 290/571] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:32 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:33.060604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2d9f90a6-6ee3-40f2-b58f-1785adbf9e5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:33.061364 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2d9f90a6-6ee3-40f2-b58f-1785adbf9e5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:33.068840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d9f90a6-6ee3-40f2-b58f-1785adbf9e5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:33.069593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d9f90a6-6ee3-40f2-b58f-1785adbf9e5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:33.070754 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d9f90a6-6ee3-40f2-b58f-1785adbf9e5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:33.071284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d9f90a6-6ee3-40f2-b58f-1785adbf9e5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:33.234414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-c10c6a9b-eaf8-41ce-8723-28a227193c42 req-e26006bb-4f3e-4fb6-a184-ea8a7ab56ece service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d70e57-0b2f-40c0-92c9-ff20698a0de0", "tag": "b4c10430-af66-4bfe-a53d-76bd44b045e3"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:33.245863 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-c10c6a9b-eaf8-41ce-8723-28a227193c42 req-e26006bb-4f3e-4fb6-a184-ea8a7ab56ece service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:33.246452 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-c10c6a9b-eaf8-41ce-8723-28a227193c42 req-e26006bb-4f3e-4fb6-a184-ea8a7ab56ece service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:33.258408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-c10c6a9b-eaf8-41ce-8723-28a227193c42 req-e26006bb-4f3e-4fb6-a184-ea8a7ab56ece service nova] Creating event network-changed:b4c10430-af66-4bfe-a53d-76bd44b045e3 for instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 on hv-cinder-81322 Jun 23 22:49:33.265106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-c10c6a9b-eaf8-41ce-8723-28a227193c42 req-e26006bb-4f3e-4fb6-a184-ea8a7ab56ece service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035237 Jun 23 22:49:33.265803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 291/572] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:49:33.282454 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2d9f90a6-6ee3-40f2-b58f-1785adbf9e5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:33.291128 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2d9f90a6-6ee3-40f2-b58f-1785adbf9e5e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.234529 Jun 23 22:49:33.292035 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 282/573] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:33 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:33.504288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-104cf1ea-0e2c-45c4-8242-e5a74df3bff5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:33.505015 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-104cf1ea-0e2c-45c4-8242-e5a74df3bff5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:33.512958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-104cf1ea-0e2c-45c4-8242-e5a74df3bff5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:33.513459 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-104cf1ea-0e2c-45c4-8242-e5a74df3bff5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:33.514219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-104cf1ea-0e2c-45c4-8242-e5a74df3bff5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:33.514651 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-104cf1ea-0e2c-45c4-8242-e5a74df3bff5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:33.654425 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-104cf1ea-0e2c-45c4-8242-e5a74df3bff5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:33.662545 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-104cf1ea-0e2c-45c4-8242-e5a74df3bff5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.162412 Jun 23 22:49:33.663104 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 292/574] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:33 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:34.307970 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-15c98037-9129-4e06-81cc-f5611677189d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:34.308884 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-15c98037-9129-4e06-81cc-f5611677189d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:34.315308 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15c98037-9129-4e06-81cc-f5611677189d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:34.315750 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15c98037-9129-4e06-81cc-f5611677189d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:34.316496 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15c98037-9129-4e06-81cc-f5611677189d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:34.316954 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15c98037-9129-4e06-81cc-f5611677189d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:34.337352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:34.447442 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-15c98037-9129-4e06-81cc-f5611677189d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:34.454724 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-15c98037-9129-4e06-81cc-f5611677189d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.151367 Jun 23 22:49:34.455289 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 283/575] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:34 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:34.678994 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e9191d8e-d963-4cbc-b8ec-873d1f6e0bee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:34.679597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e9191d8e-d963-4cbc-b8ec-873d1f6e0bee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:34.686822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e9191d8e-d963-4cbc-b8ec-873d1f6e0bee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:34.687264 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e9191d8e-d963-4cbc-b8ec-873d1f6e0bee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:34.688024 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e9191d8e-d963-4cbc-b8ec-873d1f6e0bee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:34.688460 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e9191d8e-d963-4cbc-b8ec-873d1f6e0bee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:34.706158 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:34.821094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e9191d8e-d963-4cbc-b8ec-873d1f6e0bee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:34.829115 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e9191d8e-d963-4cbc-b8ec-873d1f6e0bee tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.153890 Jun 23 22:49:34.829677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 293/576] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:34 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:35.471244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-22f8b0f1-a807-46c8-bc1d-b3dff9e88416 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:35.471981 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-22f8b0f1-a807-46c8-bc1d-b3dff9e88416 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:35.478796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22f8b0f1-a807-46c8-bc1d-b3dff9e88416 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:35.479276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22f8b0f1-a807-46c8-bc1d-b3dff9e88416 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:35.480056 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22f8b0f1-a807-46c8-bc1d-b3dff9e88416 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:35.480501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22f8b0f1-a807-46c8-bc1d-b3dff9e88416 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:35.623841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-22f8b0f1-a807-46c8-bc1d-b3dff9e88416 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:35.631183 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-22f8b0f1-a807-46c8-bc1d-b3dff9e88416 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.163802 Jun 23 22:49:35.631735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 284/577] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:35 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:35.847071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1ebecaf0-232c-4995-ae95-e7da1c93100d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:35.847675 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1ebecaf0-232c-4995-ae95-e7da1c93100d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:35.854286 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1ebecaf0-232c-4995-ae95-e7da1c93100d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:35.854774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1ebecaf0-232c-4995-ae95-e7da1c93100d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:35.861938 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1ebecaf0-232c-4995-ae95-e7da1c93100d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:35.861938 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1ebecaf0-232c-4995-ae95-e7da1c93100d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:35.987929 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1ebecaf0-232c-4995-ae95-e7da1c93100d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:35.996370 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1ebecaf0-232c-4995-ae95-e7da1c93100d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.153511 Jun 23 22:49:35.996949 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 294/578] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:35 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:36.647084 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-154f2c7e-6bab-43ce-94a4-95060954b23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:36.647690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-154f2c7e-6bab-43ce-94a4-95060954b23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:36.654200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-154f2c7e-6bab-43ce-94a4-95060954b23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:36.654638 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-154f2c7e-6bab-43ce-94a4-95060954b23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:36.655380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-154f2c7e-6bab-43ce-94a4-95060954b23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:36.655807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-154f2c7e-6bab-43ce-94a4-95060954b23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:36.784356 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-154f2c7e-6bab-43ce-94a4-95060954b23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:36.792410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-154f2c7e-6bab-43ce-94a4-95060954b23d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.148664 Jun 23 22:49:36.793021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 285/579] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:36 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:37.013420 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2d1abe58-bc70-4326-80e8-263caa71c15f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:37.013997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2d1abe58-bc70-4326-80e8-263caa71c15f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:37.020479 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d1abe58-bc70-4326-80e8-263caa71c15f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:37.021011 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d1abe58-bc70-4326-80e8-263caa71c15f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:37.021772 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d1abe58-bc70-4326-80e8-263caa71c15f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:37.022202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d1abe58-bc70-4326-80e8-263caa71c15f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:37.151937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2d1abe58-bc70-4326-80e8-263caa71c15f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:37.159461 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2d1abe58-bc70-4326-80e8-263caa71c15f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.150235 Jun 23 22:49:37.160033 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 295/580] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:37 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:37.810068 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ab723cfd-fd12-41d5-9ab8-e6c4c0a45c16 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:37.810682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ab723cfd-fd12-41d5-9ab8-e6c4c0a45c16 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:37.812535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:37.817842 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab723cfd-fd12-41d5-9ab8-e6c4c0a45c16 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:37.818325 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab723cfd-fd12-41d5-9ab8-e6c4c0a45c16 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:37.819021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab723cfd-fd12-41d5-9ab8-e6c4c0a45c16 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:37.819450 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab723cfd-fd12-41d5-9ab8-e6c4c0a45c16 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:37.949660 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ab723cfd-fd12-41d5-9ab8-e6c4c0a45c16 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:37.957139 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ab723cfd-fd12-41d5-9ab8-e6c4c0a45c16 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.151911 Jun 23 22:49:37.957716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 286/581] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:37 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:38.177720 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6425b7b8-0685-45dd-9c82-8ef520c1971c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:38.179113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6425b7b8-0685-45dd-9c82-8ef520c1971c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:38.181868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:38.183523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:38.187647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6425b7b8-0685-45dd-9c82-8ef520c1971c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:38.188103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6425b7b8-0685-45dd-9c82-8ef520c1971c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:38.188911 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6425b7b8-0685-45dd-9c82-8ef520c1971c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:38.189536 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6425b7b8-0685-45dd-9c82-8ef520c1971c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:38.206021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bf6ab49e-504f-432b-91e2-61dcf86008bf tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:38.206650 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bf6ab49e-504f-432b-91e2-61dcf86008bf tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:38.212638 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf6ab49e-504f-432b-91e2-61dcf86008bf tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:38.217696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf6ab49e-504f-432b-91e2-61dcf86008bf tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:38.217696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf6ab49e-504f-432b-91e2-61dcf86008bf tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:38.217696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf6ab49e-504f-432b-91e2-61dcf86008bf tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:38.304643 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-bf6ab49e-504f-432b-91e2-61dcf86008bf tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lazy-loading 'services' on Instance uuid 92576fd0-4632-4e5b-9487-90d4da5a1e04 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:38.335512 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6425b7b8-0685-45dd-9c82-8ef520c1971c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:38.344039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6425b7b8-0685-45dd-9c82-8ef520c1971c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1736 microversion: 2.1 time: 0.170368 Jun 23 22:49:38.346277 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 296/582] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:38 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:38.547605 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bf6ab49e-504f-432b-91e2-61dcf86008bf tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "DELETE /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04/os-volume_attachments/7062eb29-fb9d-4abf-8474-7357541720a0" status: 202 len: 0 microversion: 2.1 time: 0.345634 Jun 23 22:49:38.548195 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 287/583] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:49:38 2022] DELETE /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04/os-volume_attachments/7062eb29-fb9d-4abf-8474-7357541720a0 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 22:49:38.974328 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1e21ce0e-ec49-4265-ad06-0bf009f820dc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:38.974864 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1e21ce0e-ec49-4265-ad06-0bf009f820dc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:38.981773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1e21ce0e-ec49-4265-ad06-0bf009f820dc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:38.982224 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1e21ce0e-ec49-4265-ad06-0bf009f820dc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:38.982975 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1e21ce0e-ec49-4265-ad06-0bf009f820dc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:38.983410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1e21ce0e-ec49-4265-ad06-0bf009f820dc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.110451 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1e21ce0e-ec49-4265-ad06-0bf009f820dc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:39.118264 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1e21ce0e-ec49-4265-ad06-0bf009f820dc tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.148020 Jun 23 22:49:39.118824 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 297/584] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:38 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:39.362169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3c3be8e4-9606-4d65-a64d-fbb3bf7b8a81 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:39.362889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3c3be8e4-9606-4d65-a64d-fbb3bf7b8a81 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:39.369465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3c3be8e4-9606-4d65-a64d-fbb3bf7b8a81 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.369908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3c3be8e4-9606-4d65-a64d-fbb3bf7b8a81 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.370757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3c3be8e4-9606-4d65-a64d-fbb3bf7b8a81 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.371190 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3c3be8e4-9606-4d65-a64d-fbb3bf7b8a81 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.501576 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3c3be8e4-9606-4d65-a64d-fbb3bf7b8a81 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:39.509448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3c3be8e4-9606-4d65-a64d-fbb3bf7b8a81 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1716 microversion: 2.1 time: 0.151860 Jun 23 22:49:39.510039 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 288/585] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:39 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:39.620129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:39.621123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:39.627279 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.627735 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.628516 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.629009 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.665908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2d186ca3-f23c-445a-87d0-e6eab30f1d74 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:39.667085 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2d186ca3-f23c-445a-87d0-e6eab30f1d74 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:39.673826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d186ca3-f23c-445a-87d0-e6eab30f1d74 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.673826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d186ca3-f23c-445a-87d0-e6eab30f1d74 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.674597 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d186ca3-f23c-445a-87d0-e6eab30f1d74 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.675059 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2d186ca3-f23c-445a-87d0-e6eab30f1d74 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.711886 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2d186ca3-f23c-445a-87d0-e6eab30f1d74 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:49:39.723836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] HTTP exception thrown: Cannot 'detach_volume' instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b while it is in vm_state rescued Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Request method failure captured: Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: DELETE /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments/fa45e85a-209e-4b36-a603-ef27b2585598 HTTP/1.1 Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0Fxgf8_W6nHzji-QVv9jKiLp4rg6lH_y6-T4g881cdcaBRhykJO0GrB4dCqu9pFmtp2fywc254ujM1yS_W8gisUumxZqIVtBkou9tpTQgKGhiSBP4vuty0nKCS6oCe-_37EzZxMUls-mnqqoz3G_53dfhEX2AvYPxQ_-nmCoCt624 Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:49:39.727653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_19ed20d55acb41fcb18006919476bf80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 675d117397da452faa5221af0906fb12 Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:49:39.730180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Cannot 'detach_volume' instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b while it is in vm_state rescued Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'server_id': '9dafd3dc-6a6c-4a96-854d-e380a187a72b', 'id': 'fa45e85a-209e-4b36-a603-ef27b2585598'} Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:49:39.731026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b while it is in vm_state rescued Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b while it is in vm_state rescued Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:49:39.732250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Returning 409 to user: Cannot 'detach_volume' instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b while it is in vm_state rescued {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:49:39.733282 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-86a517c0-b9b4-4c09-9d94-c2441829a888 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments/fa45e85a-209e-4b36-a603-ef27b2585598" status: 409 len: 152 microversion: 2.1 time: 0.116051 Jun 23 22:49:39.736216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 298/586] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:49:39 2022] DELETE /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments/fa45e85a-209e-4b36-a603-ef27b2585598 => generated 152 bytes in 122 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 22:49:39.741731 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-208f82d6-c385-44a8-aab8-6a37ba0e86ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:39.746128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-208f82d6-c385-44a8-aab8-6a37ba0e86ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:39.749891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-208f82d6-c385-44a8-aab8-6a37ba0e86ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.750420 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-208f82d6-c385-44a8-aab8-6a37ba0e86ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.752021 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-208f82d6-c385-44a8-aab8-6a37ba0e86ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.752486 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-208f82d6-c385-44a8-aab8-6a37ba0e86ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.958826 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-208f82d6-c385-44a8-aab8-6a37ba0e86ed tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "POST /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/action" status: 202 len: 0 microversion: 2.1 time: 0.221169 Jun 23 22:49:39.959495 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 299/587] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:49:39 2022] POST /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:49:39.965469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-d0643b71-0a36-49d2-b365-a45e6f0f5f29 req-72d40b89-94d0-4ed3-9908-badf8a3d015b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d70e57-0b2f-40c0-92c9-ff20698a0de0", "name": "network-vif-plugged", "status": "completed", "tag": "b4c10430-af66-4bfe-a53d-76bd44b045e3"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:39.974651 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-d0643b71-0a36-49d2-b365-a45e6f0f5f29 req-72d40b89-94d0-4ed3-9908-badf8a3d015b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:39.975172 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-d0643b71-0a36-49d2-b365-a45e6f0f5f29 req-72d40b89-94d0-4ed3-9908-badf8a3d015b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:39.986762 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-d0643b71-0a36-49d2-b365-a45e6f0f5f29 req-72d40b89-94d0-4ed3-9908-badf8a3d015b service nova] Creating event network-vif-plugged:b4c10430-af66-4bfe-a53d-76bd44b045e3 for instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 on hv-cinder-81322 Jun 23 22:49:39.991719 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-d0643b71-0a36-49d2-b365-a45e6f0f5f29 req-72d40b89-94d0-4ed3-9908-badf8a3d015b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 Jun 23 22:49:39.992287 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 300/588] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:39.997267 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ce9e604e-3d06-4e1d-9843-51ec42afdd85 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:39.997981 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ce9e604e-3d06-4e1d-9843-51ec42afdd85 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:40.000934 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2d186ca3-f23c-445a-87d0-e6eab30f1d74 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "DELETE /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 204 len: 0 microversion: 2.1 time: 0.339704 Jun 23 22:49:40.001516 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 289/589] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:49:39 2022] DELETE /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:49:40.009267 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ce9e604e-3d06-4e1d-9843-51ec42afdd85 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:40.009944 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ce9e604e-3d06-4e1d-9843-51ec42afdd85 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:40.010252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5cd98185-bb9b-460a-b984-e563d9c9395a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:40.011024 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5cd98185-bb9b-460a-b984-e563d9c9395a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:40.011145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ce9e604e-3d06-4e1d-9843-51ec42afdd85 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:40.011938 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ce9e604e-3d06-4e1d-9843-51ec42afdd85 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:40.017313 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd98185-bb9b-460a-b984-e563d9c9395a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:40.017787 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd98185-bb9b-460a-b984-e563d9c9395a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:40.018730 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd98185-bb9b-460a-b984-e563d9c9395a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:40.019166 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cd98185-bb9b-460a-b984-e563d9c9395a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:40.155504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5cd98185-bb9b-460a-b984-e563d9c9395a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:40.159724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ce9e604e-3d06-4e1d-9843-51ec42afdd85 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:40.164174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5cd98185-bb9b-460a-b984-e563d9c9395a tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1513 microversion: 2.1 time: 0.157994 Jun 23 22:49:40.167917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 290/590] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:40 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:40.168755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ce9e604e-3d06-4e1d-9843-51ec42afdd85 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1724 microversion: 2.1 time: 0.175250 Jun 23 22:49:40.169318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 301/591] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:39 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:40.179468 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8029e30b-3394-4e21-9a6d-92165b106d2d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:40.180158 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8029e30b-3394-4e21-9a6d-92165b106d2d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:40.186314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8029e30b-3394-4e21-9a6d-92165b106d2d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:40.186764 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8029e30b-3394-4e21-9a6d-92165b106d2d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:40.187519 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8029e30b-3394-4e21-9a6d-92165b106d2d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:40.187957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8029e30b-3394-4e21-9a6d-92165b106d2d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:40.316895 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8029e30b-3394-4e21-9a6d-92165b106d2d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:40.325367 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8029e30b-3394-4e21-9a6d-92165b106d2d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.149576 Jun 23 22:49:40.325939 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 291/592] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:40 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:41.182333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f9f05b49-6e97-4181-b6c2-1cc7fb0789d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:41.182941 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f9f05b49-6e97-4181-b6c2-1cc7fb0789d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:41.185935 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-95e155a4-5c43-4381-9fe9-63e22068dc9d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:41.186539 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-95e155a4-5c43-4381-9fe9-63e22068dc9d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:41.189547 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f9f05b49-6e97-4181-b6c2-1cc7fb0789d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:41.189998 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f9f05b49-6e97-4181-b6c2-1cc7fb0789d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:41.190754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f9f05b49-6e97-4181-b6c2-1cc7fb0789d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:41.191218 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f9f05b49-6e97-4181-b6c2-1cc7fb0789d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:41.193147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-95e155a4-5c43-4381-9fe9-63e22068dc9d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:41.193620 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-95e155a4-5c43-4381-9fe9-63e22068dc9d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:41.194368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-95e155a4-5c43-4381-9fe9-63e22068dc9d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:41.194825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-95e155a4-5c43-4381-9fe9-63e22068dc9d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:41.321970 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f9f05b49-6e97-4181-b6c2-1cc7fb0789d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:41.330091 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f9f05b49-6e97-4181-b6c2-1cc7fb0789d2 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1513 microversion: 2.1 time: 0.151689 Jun 23 22:49:41.330653 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 302/593] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:41 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:41.340303 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-95e155a4-5c43-4381-9fe9-63e22068dc9d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:41.340303 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-95e155a4-5c43-4381-9fe9-63e22068dc9d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1724 microversion: 2.1 time: 0.157339 Jun 23 22:49:41.340303 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 292/594] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:41 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:41.342473 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0a6441e2-d9fa-42f7-8285-9f0bb8623d15 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:41.343148 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0a6441e2-d9fa-42f7-8285-9f0bb8623d15 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:41.349245 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a6441e2-d9fa-42f7-8285-9f0bb8623d15 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:41.349689 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a6441e2-d9fa-42f7-8285-9f0bb8623d15 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:41.350435 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a6441e2-d9fa-42f7-8285-9f0bb8623d15 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:41.350862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0a6441e2-d9fa-42f7-8285-9f0bb8623d15 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:41.476836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0a6441e2-d9fa-42f7-8285-9f0bb8623d15 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:41.484487 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0a6441e2-d9fa-42f7-8285-9f0bb8623d15 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.146438 Jun 23 22:49:41.485077 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 303/595] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:41 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:42.351994 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e5b135a6-c434-43ff-a44f-817f3e87b89b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:42.351994 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e5b135a6-c434-43ff-a44f-817f3e87b89b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:42.356680 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-05446522-9bbe-4ada-bf06-16b7bef2892d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:42.357294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5b135a6-c434-43ff-a44f-817f3e87b89b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:42.357404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-05446522-9bbe-4ada-bf06-16b7bef2892d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:42.357849 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5b135a6-c434-43ff-a44f-817f3e87b89b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:42.358783 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5b135a6-c434-43ff-a44f-817f3e87b89b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:42.359382 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5b135a6-c434-43ff-a44f-817f3e87b89b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:42.364283 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05446522-9bbe-4ada-bf06-16b7bef2892d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:42.364768 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05446522-9bbe-4ada-bf06-16b7bef2892d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:42.365569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05446522-9bbe-4ada-bf06-16b7bef2892d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:42.366002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-05446522-9bbe-4ada-bf06-16b7bef2892d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:42.507355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-05446522-9bbe-4ada-bf06-16b7bef2892d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:42.515594 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-05446522-9bbe-4ada-bf06-16b7bef2892d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1724 microversion: 2.1 time: 0.163647 Jun 23 22:49:42.516163 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 304/596] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:42 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:42.526084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4a99e083-2680-46ca-bfea-6b6442fa0307 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:42.526084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4a99e083-2680-46ca-bfea-6b6442fa0307 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:42.527771 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4a99e083-2680-46ca-bfea-6b6442fa0307 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:42.528216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4a99e083-2680-46ca-bfea-6b6442fa0307 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:42.529177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4a99e083-2680-46ca-bfea-6b6442fa0307 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:42.529615 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4a99e083-2680-46ca-bfea-6b6442fa0307 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:42.540999 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e5b135a6-c434-43ff-a44f-817f3e87b89b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:42.544186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e5b135a6-c434-43ff-a44f-817f3e87b89b tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1513 microversion: 2.1 time: 0.199639 Jun 23 22:49:42.544790 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 293/597] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:42 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:42.669110 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4a99e083-2680-46ca-bfea-6b6442fa0307 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:42.677172 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4a99e083-2680-46ca-bfea-6b6442fa0307 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1368 microversion: 2.1 time: 0.159914 Jun 23 22:49:42.677904 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 305/598] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:42 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:42.734150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-4bbb792e-dc07-483e-a245-d28edfce1f47 req-04305578-084b-4a56-8aea-cf5c30131232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92576fd0-4632-4e5b-9487-90d4da5a1e04", "name": "network-vif-deleted", "tag": "0af3849b-3eda-452d-a709-52a282dbce71"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:42.745294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4bbb792e-dc07-483e-a245-d28edfce1f47 req-04305578-084b-4a56-8aea-cf5c30131232 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:42.745294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4bbb792e-dc07-483e-a245-d28edfce1f47 req-04305578-084b-4a56-8aea-cf5c30131232 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:42.754549 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-4bbb792e-dc07-483e-a245-d28edfce1f47 req-04305578-084b-4a56-8aea-cf5c30131232 service nova] Creating event network-vif-deleted:0af3849b-3eda-452d-a709-52a282dbce71 for instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 on hv-cinder-81322 Jun 23 22:49:42.759392 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-4bbb792e-dc07-483e-a245-d28edfce1f47 req-04305578-084b-4a56-8aea-cf5c30131232 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028936 Jun 23 22:49:42.760697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 294/599] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:43.532643 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3a3eca57-e528-400e-9066-bd5b0873a510 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:43.533259 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3a3eca57-e528-400e-9066-bd5b0873a510 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:43.540042 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3a3eca57-e528-400e-9066-bd5b0873a510 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:43.540230 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3a3eca57-e528-400e-9066-bd5b0873a510 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:43.541504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3a3eca57-e528-400e-9066-bd5b0873a510 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:43.542194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3a3eca57-e528-400e-9066-bd5b0873a510 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:43.562964 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-04b47ac4-7da8-43f9-a701-436c56e458aa tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:43.568811 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-04b47ac4-7da8-43f9-a701-436c56e458aa tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:43.569744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04b47ac4-7da8-43f9-a701-436c56e458aa tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:43.570194 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04b47ac4-7da8-43f9-a701-436c56e458aa tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:43.570942 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04b47ac4-7da8-43f9-a701-436c56e458aa tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:43.571374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-04b47ac4-7da8-43f9-a701-436c56e458aa tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:43.642012 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-04b47ac4-7da8-43f9-a701-436c56e458aa tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:43.649887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-04b47ac4-7da8-43f9-a701-436c56e458aa tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1303 microversion: 2.1 time: 0.091782 Jun 23 22:49:43.650543 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 295/600] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:43 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:43.679485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3a3eca57-e528-400e-9066-bd5b0873a510 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:43.687760 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3a3eca57-e528-400e-9066-bd5b0873a510 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1724 microversion: 2.1 time: 0.159032 Jun 23 22:49:43.688316 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 306/601] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:43 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:43.694194 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5ec386c2-184b-409c-82de-d85de0eae9f4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:43.694804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5ec386c2-184b-409c-82de-d85de0eae9f4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:43.701249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ec386c2-184b-409c-82de-d85de0eae9f4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:43.705342 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ec386c2-184b-409c-82de-d85de0eae9f4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:43.705342 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ec386c2-184b-409c-82de-d85de0eae9f4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:43.705342 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5ec386c2-184b-409c-82de-d85de0eae9f4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:43.828020 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5ec386c2-184b-409c-82de-d85de0eae9f4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:43.835438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5ec386c2-184b-409c-82de-d85de0eae9f4 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1557 microversion: 2.1 time: 0.144983 Jun 23 22:49:43.835992 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 296/602] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:43 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1557 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:43.851978 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a54485e7-de3c-4249-98de-268076257398 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:43.852500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a54485e7-de3c-4249-98de-268076257398 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:43.859157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a54485e7-de3c-4249-98de-268076257398 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:43.859606 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a54485e7-de3c-4249-98de-268076257398 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:43.860356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a54485e7-de3c-4249-98de-268076257398 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:43.860817 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a54485e7-de3c-4249-98de-268076257398 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:43.934961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a54485e7-de3c-4249-98de-268076257398 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086771 Jun 23 22:49:43.935541 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 307/603] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 22:49:43 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:44.667179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:44.667784 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:44.674706 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:44.675153 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:44.675927 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:44.676361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:44.706246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-77bd561b-4ed3-4d7e-8b49-8c1db0b07cef tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:44.708477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-77bd561b-4ed3-4d7e-8b49-8c1db0b07cef tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:44.710080 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:44.710532 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:44.710976 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lazy-loading 'fault' on Instance uuid 92576fd0-4632-4e5b-9487-90d4da5a1e04 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:44.716970 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-77bd561b-4ed3-4d7e-8b49-8c1db0b07cef tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:44.718045 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-77bd561b-4ed3-4d7e-8b49-8c1db0b07cef tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:44.719213 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-77bd561b-4ed3-4d7e-8b49-8c1db0b07cef tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:44.719887 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-77bd561b-4ed3-4d7e-8b49-8c1db0b07cef tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:44.779808 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:44.797902 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b2c04e6b-d3a3-4bce-bd28-b5caaee86621 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1308 microversion: 2.1 time: 0.134477 Jun 23 22:49:44.798802 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 297/604] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:44 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:44.887204 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-77bd561b-4ed3-4d7e-8b49-8c1db0b07cef tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:44.895459 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-77bd561b-4ed3-4d7e-8b49-8c1db0b07cef tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1724 microversion: 2.1 time: 0.193477 Jun 23 22:49:44.896026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 308/605] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:44 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:44.949411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-0cec5119-2d7d-4a06-8a5d-ff1bc9fa89b9 req-1dd4b9fb-fe24-41e1-97d1-ad6a07295941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49d70e57-0b2f-40c0-92c9-ff20698a0de0", "tag": "b4c10430-af66-4bfe-a53d-76bd44b045e3"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:44.957881 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-0cec5119-2d7d-4a06-8a5d-ff1bc9fa89b9 req-1dd4b9fb-fe24-41e1-97d1-ad6a07295941 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:44.958409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-0cec5119-2d7d-4a06-8a5d-ff1bc9fa89b9 req-1dd4b9fb-fe24-41e1-97d1-ad6a07295941 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:44.962538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:44.972976 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-0cec5119-2d7d-4a06-8a5d-ff1bc9fa89b9 req-1dd4b9fb-fe24-41e1-97d1-ad6a07295941 service nova] Creating event network-changed:b4c10430-af66-4bfe-a53d-76bd44b045e3 for instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 on hv-cinder-81322 Jun 23 22:49:44.974827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-0cec5119-2d7d-4a06-8a5d-ff1bc9fa89b9 req-1dd4b9fb-fe24-41e1-97d1-ad6a07295941 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029049 Jun 23 22:49:44.975499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 298/606] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:49:45.815699 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:45.816958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:45.823829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:45.824272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:45.825078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:45.825724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:45.862286 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:45.863135 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:45.863665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lazy-loading 'fault' on Instance uuid 92576fd0-4632-4e5b-9487-90d4da5a1e04 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:45.914446 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c1d601c4-5183-4730-b93c-350445c9227c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:45.915158 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c1d601c4-5183-4730-b93c-350445c9227c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:45.921046 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd98b2a31e4c46599269684782915703', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb1c26e7fcbd4c0c9bb4a68e54569e3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:45.924504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1d601c4-5183-4730-b93c-350445c9227c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:45.925192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1d601c4-5183-4730-b93c-350445c9227c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:45.925876 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:45.926297 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1d601c4-5183-4730-b93c-350445c9227c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:45.926889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1d601c4-5183-4730-b93c-350445c9227c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:45.930783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cca0d32e-2b2d-4c61-8d34-4bcf5e092f70 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 200 len: 1308 microversion: 2.1 time: 0.119152 Jun 23 22:49:45.931572 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 309/607] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:45 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:46.362734 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c1d601c4-5183-4730-b93c-350445c9227c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:46.369749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c1d601c4-5183-4730-b93c-350445c9227c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1730 microversion: 2.1 time: 0.460496 Jun 23 22:49:46.370307 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 299/608] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:45 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1730 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:49:46.386500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fd33ae9f-6b84-453a-ab7e-8b2ed7915db4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:46.398666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fd33ae9f-6b84-453a-ab7e-8b2ed7915db4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:46.398666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd33ae9f-6b84-453a-ab7e-8b2ed7915db4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:46.398666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd33ae9f-6b84-453a-ab7e-8b2ed7915db4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:46.398666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd33ae9f-6b84-453a-ab7e-8b2ed7915db4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:46.399182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fd33ae9f-6b84-453a-ab7e-8b2ed7915db4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:46.473874 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fd33ae9f-6b84-453a-ab7e-8b2ed7915db4 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091219 Jun 23 22:49:46.474701 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 310/609] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 22:49:46 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:46.947231 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:46.947829 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] [instance: 92576fd0-4632-4e5b-9487-90d4da5a1e04] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:46.955361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:46.955803 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:46.956557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:46.957003 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:46.970340 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] HTTP exception thrown: Instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 could not be found. Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Request method failure captured: Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 HTTP/1.1 Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO1eMzFVc3rzLzmfG6GGu1NFSaCn9Ywjbl487QGZDU1-SZVCCUzhiHgkEH5RMOLwQY9rZIy1uRJj1R7-Pt6XAq2ckvZQwlP0TJfdOCywF93GF6C1jJ4lc_W-qc-Lhl3u039Vqde9xjICUJp4lABxIbqeYR8mgzElPyZLefPXTmTLXZE Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: cb1c26e7fcbd4c0c9bb4a68e54569e3a Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesSnapshotTestJSON-33166903 Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:49:46.971883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cb1c26e7fcbd4c0c9bb4a68e54569e3a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cb1c26e7fcbd4c0c9bb4a68e54569e3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb1c26e7fcbd4c0c9bb4a68e54569e3a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cb1c26e7fcbd4c0c9bb4a68e54569e3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesSnapshotTestJSON-33166903 Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: cb1c26e7fcbd4c0c9bb4a68e54569e3a Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-33166903 Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesSnapshotTestJSON-33166903-project Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: dd98b2a31e4c46599269684782915703 Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesSnapshotTestJSON-33166903-project Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 could not be found. Jun 23 22:49:46.973270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '92576fd0-4632-4e5b-9487-90d4da5a1e04'} Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 could not be found. Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:49:46.974186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 could not be found. Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 could not be found. Jun 23 22:49:46.975731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:49:46.976853 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] Returning 404 to user: Instance 92576fd0-4632-4e5b-9487-90d4da5a1e04 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:49:46.976853 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fbf87ecc-b922-4f4f-a799-8156c2994068 tempest-VolumesSnapshotTestJSON-33166903 tempest-VolumesSnapshotTestJSON-33166903-project] 10.222.0.33 "GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04" status: 404 len: 111 microversion: 2.1 time: 0.029963 Jun 23 22:49:46.976853 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 300/610] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:49:46 2022] GET /compute/v2.1/servers/92576fd0-4632-4e5b-9487-90d4da5a1e04 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:49:47.399850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-56754bb4-14d8-41e5-acbf-1af289fd6f03 req-ebb32182-bf5c-4d3e-ba11-c46194343a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dafd3dc-6a6c-4a96-854d-e380a187a72b", "tag": "605d9a1c-2adc-425e-a04a-51601319bff5"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:47.404418 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:47.421247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-56754bb4-14d8-41e5-acbf-1af289fd6f03 req-ebb32182-bf5c-4d3e-ba11-c46194343a17 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:47.421696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-56754bb4-14d8-41e5-acbf-1af289fd6f03 req-ebb32182-bf5c-4d3e-ba11-c46194343a17 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:47.433312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-56754bb4-14d8-41e5-acbf-1af289fd6f03 req-ebb32182-bf5c-4d3e-ba11-c46194343a17 service nova] Creating event network-changed:605d9a1c-2adc-425e-a04a-51601319bff5 for instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b on hv-cinder-81322 Jun 23 22:49:47.438243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-56754bb4-14d8-41e5-acbf-1af289fd6f03 req-ebb32182-bf5c-4d3e-ba11-c46194343a17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041992 Jun 23 22:49:47.445231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 311/611] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:49.452223 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-82ee4ab7-b4ac-4bbd-a7a8-b1b76d124022 req-fd6b4004-3bd3-4ecf-b11a-49f0b123556b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dafd3dc-6a6c-4a96-854d-e380a187a72b", "tag": "605d9a1c-2adc-425e-a04a-51601319bff5"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:49:49.460737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-82ee4ab7-b4ac-4bbd-a7a8-b1b76d124022 req-fd6b4004-3bd3-4ecf-b11a-49f0b123556b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:49.461174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-82ee4ab7-b4ac-4bbd-a7a8-b1b76d124022 req-fd6b4004-3bd3-4ecf-b11a-49f0b123556b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:49.472026 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-82ee4ab7-b4ac-4bbd-a7a8-b1b76d124022 req-fd6b4004-3bd3-4ecf-b11a-49f0b123556b service nova] Creating event network-changed:605d9a1c-2adc-425e-a04a-51601319bff5 for instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b on hv-cinder-81322 Jun 23 22:49:49.476977 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-82ee4ab7-b4ac-4bbd-a7a8-b1b76d124022 req-fd6b4004-3bd3-4ecf-b11a-49f0b123556b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028403 Jun 23 22:49:49.477722 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 301/612] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:49:54.923788 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8d4306e8-fdb7-40ca-847d-e413f7f0e6a8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:54.924367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8d4306e8-fdb7-40ca-847d-e413f7f0e6a8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:54.931008 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8d4306e8-fdb7-40ca-847d-e413f7f0e6a8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:54.931451 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8d4306e8-fdb7-40ca-847d-e413f7f0e6a8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:54.932207 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8d4306e8-fdb7-40ca-847d-e413f7f0e6a8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:54.932675 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8d4306e8-fdb7-40ca-847d-e413f7f0e6a8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:54.961363 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8d4306e8-fdb7-40ca-847d-e413f7f0e6a8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments/5634d54c-320b-4100-91dc-cde76e2583b6" status: 200 len: 194 microversion: 2.20 time: 0.043379 Jun 23 22:49:54.961929 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 312/613] 10.222.0.33 () {60 vars in 1453 bytes} [Thu Jun 23 22:49:54 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments/5634d54c-320b-4100-91dc-cde76e2583b6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 22:49:55.026190 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-278ac5c2-41b3-4236-b37e-2d7fb78d63f1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:55.026764 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-278ac5c2-41b3-4236-b37e-2d7fb78d63f1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:55.029780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:49:55.034957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-278ac5c2-41b3-4236-b37e-2d7fb78d63f1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:55.035411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-278ac5c2-41b3-4236-b37e-2d7fb78d63f1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:55.036169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-278ac5c2-41b3-4236-b37e-2d7fb78d63f1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:55.036621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-278ac5c2-41b3-4236-b37e-2d7fb78d63f1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:55.122530 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-278ac5c2-41b3-4236-b37e-2d7fb78d63f1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lazy-loading 'services' on Instance uuid 286fefab-3729-4c09-a3be-0af864c6de65 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:49:55.324059 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-278ac5c2-41b3-4236-b37e-2d7fb78d63f1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments/5634d54c-320b-4100-91dc-cde76e2583b6" status: 202 len: 0 microversion: 2.20 time: 0.301979 Jun 23 22:49:55.324710 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 302/614] 10.222.0.33 () {60 vars in 1456 bytes} [Thu Jun 23 22:49:55 2022] DELETE /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments/5634d54c-320b-4100-91dc-cde76e2583b6 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:49:55.333858 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-801220b3-fbcf-4cc0-bc4a-c6d001f95e05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:55.335143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-801220b3-fbcf-4cc0-bc4a-c6d001f95e05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:55.341164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-801220b3-fbcf-4cc0-bc4a-c6d001f95e05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:55.342362 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-801220b3-fbcf-4cc0-bc4a-c6d001f95e05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:55.343580 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-801220b3-fbcf-4cc0-bc4a-c6d001f95e05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:55.344022 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-801220b3-fbcf-4cc0-bc4a-c6d001f95e05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:55.372990 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-801220b3-fbcf-4cc0-bc4a-c6d001f95e05 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042871 Jun 23 22:49:55.373774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 313/615] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 23 22:49:55 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:49:56.384989 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b997e30e-5b7d-427d-ba5e-7f85eb015790 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:56.386078 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b997e30e-5b7d-427d-ba5e-7f85eb015790 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:56.393296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b997e30e-5b7d-427d-ba5e-7f85eb015790 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:56.393746 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b997e30e-5b7d-427d-ba5e-7f85eb015790 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:56.394502 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b997e30e-5b7d-427d-ba5e-7f85eb015790 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:56.394940 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b997e30e-5b7d-427d-ba5e-7f85eb015790 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:56.428927 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b997e30e-5b7d-427d-ba5e-7f85eb015790 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048275 Jun 23 22:49:56.429709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 303/616] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 23 22:49:56 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:49:57.445946 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-92736eed-daab-49e0-911b-ddbcbeb3ee23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:57.446884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-92736eed-daab-49e0-911b-ddbcbeb3ee23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:57.454353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-92736eed-daab-49e0-911b-ddbcbeb3ee23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:57.454806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-92736eed-daab-49e0-911b-ddbcbeb3ee23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:57.455568 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-92736eed-daab-49e0-911b-ddbcbeb3ee23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:57.456038 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-92736eed-daab-49e0-911b-ddbcbeb3ee23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:57.485010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-92736eed-daab-49e0-911b-ddbcbeb3ee23 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043035 Jun 23 22:49:57.485564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 314/617] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 23 22:49:57 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:49:57.543836 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5c58659c-df25-473d-9fdb-2657b6061b17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:57.544327 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c58659c-df25-473d-9fdb-2657b6061b17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:57.551452 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c58659c-df25-473d-9fdb-2657b6061b17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:57.551931 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c58659c-df25-473d-9fdb-2657b6061b17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:57.552721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c58659c-df25-473d-9fdb-2657b6061b17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:57.553158 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c58659c-df25-473d-9fdb-2657b6061b17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:57.579479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c58659c-df25-473d-9fdb-2657b6061b17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:49:57.788530 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5c58659c-df25-473d-9fdb-2657b6061b17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 204 len: 0 microversion: 2.20 time: 0.248239 Jun 23 22:49:57.789165 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 304/618] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 23 22:49:57 2022] DELETE /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 22:49:57.798216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:57.798765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:57.804925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:57.805365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:57.806127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:57.806561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:57.939166 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:57.947052 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:57.948551 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:57.949713 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5d5fdd16-01ff-42ea-a398-795dfbbd4b13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.156088 Jun 23 22:49:57.950254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 315/619] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:57 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:49:58.967820 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:49:58.968510 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:49:58.975314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:58.975767 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:58.976525 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:49:58.976988 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:49:59.105866 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:59.115117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:59.116741 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:49:59.117898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e019e9fd-5907-476c-b774-3e7d9e0050ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.154413 Jun 23 22:49:59.118456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 305/620] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:49:58 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:00.137193 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:00.137813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:00.145446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:00.145924 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:00.146687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:00.147129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:00.275818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:00.284179 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:00.285723 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:00.286880 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-12bbacd5-476c-4f7f-8956-bf3f846d0e71 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.153624 Jun 23 22:50:00.287432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 316/621] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:00 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:01.306673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:01.307278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:01.313927 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:01.316966 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:01.316966 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:01.316966 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:01.517109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:01.525123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:01.526608 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:01.527744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-82651af3-20d4-4185-a4cd-9f9ad743e2fd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1723 microversion: 2.20 time: 0.225151 Jun 23 22:50:01.528298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 306/622] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:01 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:02.269460 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-4ef448d2-b52d-441c-b016-54ece3cecd16 req-a54491ec-ec05-4bc0-aa2f-f8a7350e460b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "286fefab-3729-4c09-a3be-0af864c6de65", "name": "network-vif-deleted", "tag": "b2734dfe-80ab-464a-85a5-81204d7db18e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:02.280216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-4ef448d2-b52d-441c-b016-54ece3cecd16 req-a54491ec-ec05-4bc0-aa2f-f8a7350e460b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:02.280771 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-4ef448d2-b52d-441c-b016-54ece3cecd16 req-a54491ec-ec05-4bc0-aa2f-f8a7350e460b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:02.293497 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-4ef448d2-b52d-441c-b016-54ece3cecd16 req-a54491ec-ec05-4bc0-aa2f-f8a7350e460b service nova] Creating event network-vif-deleted:b2734dfe-80ab-464a-85a5-81204d7db18e for instance 286fefab-3729-4c09-a3be-0af864c6de65 on hv-cinder-81322 Jun 23 22:50:02.299522 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-4ef448d2-b52d-441c-b016-54ece3cecd16 req-a54491ec-ec05-4bc0-aa2f-f8a7350e460b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034220 Jun 23 22:50:02.300527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 317/623] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:02.547060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:02.547667 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:02.554188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:02.554641 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:02.555389 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:02.555990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:02.629971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:02.638360 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:02.639854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:02.641791 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-da4dd9c8-741a-430c-8c1a-bfcdb5062ffc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 200 len: 1367 microversion: 2.20 time: 0.098658 Jun 23 22:50:02.642350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 307/624] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:02 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 1367 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:03.660414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:03.661131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:03.667369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:03.667812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:03.668604 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:03.669038 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:03.682700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] HTTP exception thrown: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Request method failure captured: Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 HTTP/1.1 Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitOz7G8dX9Rg5ZaZ2hz-_kwX-6RFH2YraqKEhNp9P3mPgW4-LHDWKo_WERUB4sUdoWFRg3ah1uyEIDxOs3fxQ1bn7aCFjUx1ptXBwzmJgEvgTG1J6OSQT8UhqE3KlgAIcnEBrZrrqPwM6L5TX_TUbf4I5vKTJNIIQCZRDD8gr6YNyqAc Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:50:03.684310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_13b00f92bcc449daadba8838f4c87a62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 5107e87ee4c34ef9ac96fa4a3a899bda Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:50:03.686050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '286fefab-3729-4c09-a3be-0af864c6de65'} Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:50:03.686917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:50:03.688952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:03.690314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Returning 404 to user: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:50:03.690314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-15f13c88-e1a7-45e5-95b2-555f5ce578c5 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 404 len: 111 microversion: 2.20 time: 0.030177 Jun 23 22:50:03.690314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 318/625] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:03 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:50:03.694972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8d59e2a2-6bc3-49ec-980c-18167a44e587 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '.version_select at 0x7fbbca236820>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:03.778304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8d59e2a2-6bc3-49ec-980c-18167a44e587 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967843072" status: 204 len: 0 microversion: 2.20 time: 0.087080 Jun 23 22:50:03.778891 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 308/626] 10.222.0.33 () {60 vars in 1261 bytes} [Thu Jun 23 22:50:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967843072 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 22:50:04.553784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0146e363-f692-4e96-91ff-95579a9f3cff tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'create', calling method: .version_select at 0x7fbbca394940>, body: {"keypair": {"name": "tempest-keypair-2127631303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4XUVQ+AXLxlo8dwsVGek+l064IkSOAHGPAo1lyfbWQfDHFcrqhEufosJsUhE6sFB+E6IYkDuXZAAJlfALTJWEw90csC375+x5ISGBLL36nxA613069wJjaHiD7gVWt+w=="}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:04.568007 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-0146e363-f692-4e96-91ff-95579a9f3cff tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Getting quotas for project 13b00f92bcc449daadba8838f4c87a62. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:50:04.571955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-0146e363-f692-4e96-91ff-95579a9f3cff tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Getting quotas for user 5107e87ee4c34ef9ac96fa4a3a899bda and project 13b00f92bcc449daadba8838f4c87a62. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:50:04.679820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0146e363-f692-4e96-91ff-95579a9f3cff tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.129931 Jun 23 22:50:04.680465 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 319/627] 10.222.0.33 () {62 vars in 1199 bytes} [Thu Jun 23 22:50:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 22:50:07.045499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-312177676", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3508be72-eea9-4318-a47b-fd952236da0b"}], "security_groups": [{"name": "tempest-securitygroup--843365981"}], "key_name": "tempest-keypair-2127631303", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:07.307790 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] validate_networks() for [('3508be72-eea9-4318-a47b-fd952236da0b', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:50:07.670231 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:50:07.670653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:50:07.671127 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:50:07.671537 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:50:07.671949 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:50:07.681629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:07.682130 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:07.682962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:07.683403 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:07.701128 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Getting quotas for project 13b00f92bcc449daadba8838f4c87a62. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:50:07.705107 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Getting quotas for user 5107e87ee4c34ef9ac96fa4a3a899bda and project 13b00f92bcc449daadba8838f4c87a62. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:50:07.716976 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:50:07.719278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:50:07.858615 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-87c2d02e-5780-4a7c-9fdc-7bef0f6d25be tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.817526 Jun 23 22:50:07.859172 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 309/628] 10.222.0.33 () {62 vars in 1187 bytes} [Thu Jun 23 22:50:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 23 22:50:07.869808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c59db7e7-80b0-4fb8-8ade-2f6b2ddbb62d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:07.870414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c59db7e7-80b0-4fb8-8ade-2f6b2ddbb62d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:07.924005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c59db7e7-80b0-4fb8-8ade-2f6b2ddbb62d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:07.932188 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c59db7e7-80b0-4fb8-8ade-2f6b2ddbb62d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:07.933793 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c59db7e7-80b0-4fb8-8ade-2f6b2ddbb62d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:07.934958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c59db7e7-80b0-4fb8-8ade-2f6b2ddbb62d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1281 microversion: 2.20 time: 0.068987 Jun 23 22:50:07.935579 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 320/629] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:07 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:08.954669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:08.955271 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:08.962971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:08.963428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:08.964197 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:08.964731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:09.027432 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:09.035453 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:09.037003 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:09.038123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0d5b2d82-e9b9-426f-8484-632b78a5a4ef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1285 microversion: 2.20 time: 0.087882 Jun 23 22:50:09.038659 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 310/630] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:08 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:10.057876 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:10.057876 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:10.063157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:10.063623 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:10.064381 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:10.064882 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:10.250567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:10.259251 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:10.261039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:10.262413 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-99e5822a-a5de-4806-8854-df78b16fec17 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1351 microversion: 2.20 time: 0.210287 Jun 23 22:50:10.262846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 321/631] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:10 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1351 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:11.281159 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:11.281783 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:11.293417 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:11.295966 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:11.295966 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:11.295966 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:11.513598 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:11.520003 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:11.521567 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:11.522694 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3fc868f9-9916-409c-8246-e381ddf2fbb1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1406 microversion: 2.20 time: 0.245603 Jun 23 22:50:11.523261 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 311/632] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:11 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:11.650469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-aaf59767-108d-4cb3-8c3d-dc5ebbd83acf req-9dae3330-48c1-44c5-8f89-0f6bef5bf20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b650e20d-eaa7-4c0c-a6c1-972b92705862", "tag": "03231fbd-1795-4f15-8223-fd8df18479b9"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:11.662873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-aaf59767-108d-4cb3-8c3d-dc5ebbd83acf req-9dae3330-48c1-44c5-8f89-0f6bef5bf20f service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:11.663322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-aaf59767-108d-4cb3-8c3d-dc5ebbd83acf req-9dae3330-48c1-44c5-8f89-0f6bef5bf20f service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:11.682961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-aaf59767-108d-4cb3-8c3d-dc5ebbd83acf req-9dae3330-48c1-44c5-8f89-0f6bef5bf20f service nova] Creating event network-changed:03231fbd-1795-4f15-8223-fd8df18479b9 for instance b650e20d-eaa7-4c0c-a6c1-972b92705862 on hv-cinder-81322 Jun 23 22:50:11.694587 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-aaf59767-108d-4cb3-8c3d-dc5ebbd83acf req-9dae3330-48c1-44c5-8f89-0f6bef5bf20f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053782 Jun 23 22:50:11.695119 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 322/633] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:12.540800 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:12.541406 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:12.547810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:12.548251 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:12.549032 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:12.549464 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:12.682583 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:12.690494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:12.692659 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:12.693763 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1496b0c9-780c-4441-8222-d5d5727965da tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1406 microversion: 2.20 time: 0.156888 Jun 23 22:50:12.694311 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 312/634] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:12 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:13.713178 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:13.714548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:13.721428 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:13.722248 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:13.723333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:13.723948 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:13.907814 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:13.915890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:13.917592 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:13.918698 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-24a34c21-dfab-4e62-8cab-a75934e9e362 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1406 microversion: 2.20 time: 0.210571 Jun 23 22:50:13.919247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 323/635] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:13 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:14.079190 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-af6d71b0-f381-4adb-abe1-a89fecf97a67 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:14.079712 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-af6d71b0-f381-4adb-abe1-a89fecf97a67 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:14.087222 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af6d71b0-f381-4adb-abe1-a89fecf97a67 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:14.087670 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af6d71b0-f381-4adb-abe1-a89fecf97a67 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:14.088522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af6d71b0-f381-4adb-abe1-a89fecf97a67 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:14.089089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-af6d71b0-f381-4adb-abe1-a89fecf97a67 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:14.117593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-af6d71b0-f381-4adb-abe1-a89fecf97a67 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:50:14.398359 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-af6d71b0-f381-4adb-abe1-a89fecf97a67 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 204 len: 0 microversion: 2.1 time: 0.322586 Jun 23 22:50:14.399016 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 313/636] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:50:14 2022] DELETE /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:50:14.407197 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-56cac212-313d-4b27-9896-a8627556be71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:14.408209 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-56cac212-313d-4b27-9896-a8627556be71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:14.415329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-56cac212-313d-4b27-9896-a8627556be71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:14.415787 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-56cac212-313d-4b27-9896-a8627556be71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:14.416637 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-56cac212-313d-4b27-9896-a8627556be71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:14.417228 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-56cac212-313d-4b27-9896-a8627556be71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:14.549266 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-56cac212-313d-4b27-9896-a8627556be71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:14.557623 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-56cac212-313d-4b27-9896-a8627556be71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1578 microversion: 2.1 time: 0.154322 Jun 23 22:50:14.558187 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 324/637] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:14 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:14.938157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:14.938789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:14.945496 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:14.945977 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:14.948703 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:14.948703 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:14.966121 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:15.081334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:15.091534 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:15.093071 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:15.094308 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-431cfbdc-137d-4921-8d16-3d624e8f6986 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1406 microversion: 2.20 time: 0.160645 Jun 23 22:50:15.094871 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 314/638] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:14 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:15.575089 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-23d1a35d-d99b-4ef6-945c-75ceaa37df6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:15.575620 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-23d1a35d-d99b-4ef6-945c-75ceaa37df6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:15.582988 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23d1a35d-d99b-4ef6-945c-75ceaa37df6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:15.583602 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23d1a35d-d99b-4ef6-945c-75ceaa37df6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:15.584367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23d1a35d-d99b-4ef6-945c-75ceaa37df6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:15.584838 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23d1a35d-d99b-4ef6-945c-75ceaa37df6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:15.783997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-23d1a35d-d99b-4ef6-945c-75ceaa37df6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:15.792912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-23d1a35d-d99b-4ef6-945c-75ceaa37df6c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1578 microversion: 2.1 time: 0.221762 Jun 23 22:50:15.793485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 325/639] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:15 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:16.000935 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-cb4410a6-5e75-48a4-aafa-d199beb2d71a req-34d19989-1fa2-4fce-bafc-933d2ff67975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b650e20d-eaa7-4c0c-a6c1-972b92705862", "name": "network-vif-plugged", "status": "completed", "tag": "03231fbd-1795-4f15-8223-fd8df18479b9"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:16.010148 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-cb4410a6-5e75-48a4-aafa-d199beb2d71a req-34d19989-1fa2-4fce-bafc-933d2ff67975 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:16.010597 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-cb4410a6-5e75-48a4-aafa-d199beb2d71a req-34d19989-1fa2-4fce-bafc-933d2ff67975 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:16.021897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-cb4410a6-5e75-48a4-aafa-d199beb2d71a req-34d19989-1fa2-4fce-bafc-933d2ff67975 service nova] Creating event network-vif-plugged:03231fbd-1795-4f15-8223-fd8df18479b9 for instance b650e20d-eaa7-4c0c-a6c1-972b92705862 on hv-cinder-81322 Jun 23 22:50:16.026776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-cb4410a6-5e75-48a4-aafa-d199beb2d71a req-34d19989-1fa2-4fce-bafc-933d2ff67975 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030039 Jun 23 22:50:16.027353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 315/640] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:16.112223 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:16.112873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:16.122712 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:16.123163 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:16.124130 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:16.124684 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:16.282608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:16.292346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:16.294164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:16.295400 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-36a4c68d-af26-49da-8d8e-5273d7379dd2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1406 microversion: 2.20 time: 0.187803 Jun 23 22:50:16.295889 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 326/641] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:16 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:16.812283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1356af28-1511-4f80-b598-45000040af28 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:16.813027 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1356af28-1511-4f80-b598-45000040af28 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:16.819778 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1356af28-1511-4f80-b598-45000040af28 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:16.820235 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1356af28-1511-4f80-b598-45000040af28 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:16.821181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1356af28-1511-4f80-b598-45000040af28 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:16.821991 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1356af28-1511-4f80-b598-45000040af28 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:17.071559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1356af28-1511-4f80-b598-45000040af28 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:17.084047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1356af28-1511-4f80-b598-45000040af28 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1578 microversion: 2.1 time: 0.277174 Jun 23 22:50:17.085503 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 316/642] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:16 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1578 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:17.272107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-7671cc35-a9c9-4fbc-b604-f526211e06f3 req-290a6839-899b-4dc7-8bc0-6992031a8354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "888abca9-182a-4b16-bca8-0d861635e4a8", "name": "network-vif-deleted", "tag": "9f8c9881-9990-481d-add2-75dd48a6c858"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:17.281943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7671cc35-a9c9-4fbc-b604-f526211e06f3 req-290a6839-899b-4dc7-8bc0-6992031a8354 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:17.282744 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7671cc35-a9c9-4fbc-b604-f526211e06f3 req-290a6839-899b-4dc7-8bc0-6992031a8354 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:17.298945 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-7671cc35-a9c9-4fbc-b604-f526211e06f3 req-290a6839-899b-4dc7-8bc0-6992031a8354 service nova] Creating event network-vif-deleted:9f8c9881-9990-481d-add2-75dd48a6c858 for instance 888abca9-182a-4b16-bca8-0d861635e4a8 on hv-cinder-81322 Jun 23 22:50:17.306265 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-7671cc35-a9c9-4fbc-b604-f526211e06f3 req-290a6839-899b-4dc7-8bc0-6992031a8354 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039760 Jun 23 22:50:17.314054 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 327/643] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:17.642452 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:17.643481 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:17.650715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:17.651464 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:17.652492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:17.654241 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:17.702620 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:17.730909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:17.855784 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:17.864127 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:17.865936 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:17.867041 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7f816c8b-4788-417f-8f25-c20527624a41 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1406 microversion: 2.20 time: 0.556956 Jun 23 22:50:17.867825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 317/644] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:17 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1406 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:18.101292 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:18.108437 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:18.109509 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:18.117463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:18.119997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:18.121611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:18.122244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:18.128221 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=75 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:18.166025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:18.166862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:18.167561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lazy-loading 'fault' on Instance uuid 888abca9-182a-4b16-bca8-0d861635e4a8 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:50:18.527315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:18.537679 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-042a653e-bceb-4687-9cda-4130930d52d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1229 microversion: 2.1 time: 0.437982 Jun 23 22:50:18.540707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 328/645] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:18 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1229 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:18.885494 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:18.886097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:18.900259 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:18.901261 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:18.903327 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:18.905722 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:19.127531 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:19.142487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:19.145560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:19.147006 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7b119bb2-342b-4e90-bf7e-642ea410107a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1597 microversion: 2.20 time: 0.265666 Jun 23 22:50:19.148228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 318/646] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:50:18 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1597 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:50:19.165273 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-be2b1092-0f41-4e74-9b6b-3cd615204b74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:19.165750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-be2b1092-0f41-4e74-9b6b-3cd615204b74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:19.172066 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be2b1092-0f41-4e74-9b6b-3cd615204b74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:19.172515 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be2b1092-0f41-4e74-9b6b-3cd615204b74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:19.173352 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be2b1092-0f41-4e74-9b6b-3cd615204b74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:19.173791 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be2b1092-0f41-4e74-9b6b-3cd615204b74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:19.295424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-be2b1092-0f41-4e74-9b6b-3cd615204b74 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.134509 Jun 23 22:50:19.296246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 329/647] 10.222.0.33 () {60 vars in 1315 bytes} [Thu Jun 23 22:50:19 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:50:19.557996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:19.561769 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:19.569693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:19.570410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:19.572278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:19.572928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:19.611415 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:19.612163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:19.612663 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lazy-loading 'fault' on Instance uuid 888abca9-182a-4b16-bca8-0d861635e4a8 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:50:19.698822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:19.716737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-45beb6dc-6568-43a5-9c26-9fa6eae17843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 200 len: 1183 microversion: 2.1 time: 0.163834 Jun 23 22:50:19.728549 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 319/648] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:19 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 1183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:20.735372 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:20.736807 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:20.748328 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:20.750908 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:20.753549 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:20.754898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:20.791631 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] HTTP exception thrown: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Request method failure captured: Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 HTTP/1.1 Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO1Ifp4oILoHmPJSineDOmAtLsgWRSOxMJ8-GnSpfMX2-mQ9jiEAHf4gkqYsvbpjrcgsSfkV7OirX1iDTOIjn-1DNEZDVbqq-5DKX-vZejyeOSyP7BeMynoGED9t5rf3S3Ur1s_rA637CbFjJX0fUbsR2F2mrsEWNwaDP85v3nR6isA Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:50:20.793347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6fdc472916934fac985e88fb6a61290b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-TestVolumeBootPattern-155797815 Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 84a5fb262284400591cf29dd13771ee7 Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:50:20.794943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '888abca9-182a-4b16-bca8-0d861635e4a8'} Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:50:20.795717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:50:20.796920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:20.799746 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Returning 404 to user: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:50:20.807445 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-28c3f705-0cfd-4d47-a271-f9083d43e839 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 404 len: 111 microversion: 2.1 time: 0.076767 Jun 23 22:50:20.809151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 330/649] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:20 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:50:20.927019 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-3e71f34f-4076-45bf-9ca4-ec3f90d58faf req-2dedc395-30ae-443c-ac34-9eff14a33fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b650e20d-eaa7-4c0c-a6c1-972b92705862", "tag": "03231fbd-1795-4f15-8223-fd8df18479b9"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:20.953314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3e71f34f-4076-45bf-9ca4-ec3f90d58faf req-2dedc395-30ae-443c-ac34-9eff14a33fd6 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:20.954057 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3e71f34f-4076-45bf-9ca4-ec3f90d58faf req-2dedc395-30ae-443c-ac34-9eff14a33fd6 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:20.980624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-3e71f34f-4076-45bf-9ca4-ec3f90d58faf req-2dedc395-30ae-443c-ac34-9eff14a33fd6 service nova] Creating event network-changed:03231fbd-1795-4f15-8223-fd8df18479b9 for instance b650e20d-eaa7-4c0c-a6c1-972b92705862 on hv-cinder-81322 Jun 23 22:50:20.982476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2085690801", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-546473830", "security_groups": [{"name": "tempest-secgroup-smoke-1398705249"}], "block_device_mapping_v2": [{"uuid": "f94c41f0-82f7-4836-9137-cf8135cbef2e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "89376fea-def3-4053-a062-fad013e2e839"}]}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:20.987510 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-3e71f34f-4076-45bf-9ca4-ec3f90d58faf req-2dedc395-30ae-443c-ac34-9eff14a33fd6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065646 Jun 23 22:50:20.988307 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 320/650] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:21.165640 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.network.neutron [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] validate_networks() for [('89376fea-def3-4053-a062-fad013e2e839', None, None, None, None, None)] {{(pid=124724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:50:21.678208 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Flavor limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:50:21.682641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Image limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:50:21.682641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Flavor pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:50:21.682641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Image pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:50:21.682641 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:50:21.697451 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:21.698157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:21.699129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:21.699558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:21.723258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Getting quotas for project 6fdc472916934fac985e88fb6a61290b. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:50:21.728010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Getting quotas for user 84a5fb262284400591cf29dd13771ee7 and project 6fdc472916934fac985e88fb6a61290b. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:50:21.818429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Going to run 1 instances... {{(pid=124724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:50:21.821658 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f94c41f0-82f7-4836-9137-cf8135cbef2e',volume_size=None,volume_type=None)] {{(pid=124724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:50:22.271382 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f1776549-125f-477f-90d0-b9f1d8cf9751 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.294180 Jun 23 22:50:22.272890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 331/651] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:50:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 22:50:22.288138 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9e2d4742-3435-41ec-a2f7-2051f59768dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:22.289097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9e2d4742-3435-41ec-a2f7-2051f59768dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:22.370516 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9e2d4742-3435-41ec-a2f7-2051f59768dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:22.379258 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9e2d4742-3435-41ec-a2f7-2051f59768dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1094 microversion: 2.1 time: 0.099672 Jun 23 22:50:22.379835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 321/652] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:22 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:23.398805 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2095fb15-2aad-4389-85a1-0a53d01bd249 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:23.399452 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2095fb15-2aad-4389-85a1-0a53d01bd249 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:23.406440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2095fb15-2aad-4389-85a1-0a53d01bd249 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:23.406897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2095fb15-2aad-4389-85a1-0a53d01bd249 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:23.407719 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2095fb15-2aad-4389-85a1-0a53d01bd249 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:23.408162 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2095fb15-2aad-4389-85a1-0a53d01bd249 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:23.471431 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2095fb15-2aad-4389-85a1-0a53d01bd249 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:23.480713 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2095fb15-2aad-4389-85a1-0a53d01bd249 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1144 microversion: 2.1 time: 0.088300 Jun 23 22:50:23.481304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 332/653] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:23 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:24.497922 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7a2422a1-c5a6-4bcb-8757-9fd92c93890c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:24.498517 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7a2422a1-c5a6-4bcb-8757-9fd92c93890c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:24.528005 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a2422a1-c5a6-4bcb-8757-9fd92c93890c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:24.528466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a2422a1-c5a6-4bcb-8757-9fd92c93890c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:24.529336 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a2422a1-c5a6-4bcb-8757-9fd92c93890c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:24.529787 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a2422a1-c5a6-4bcb-8757-9fd92c93890c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:24.659185 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7a2422a1-c5a6-4bcb-8757-9fd92c93890c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:24.670283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7a2422a1-c5a6-4bcb-8757-9fd92c93890c tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1200 microversion: 2.1 time: 0.176246 Jun 23 22:50:24.671537 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 322/654] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:24 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1200 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:25.370629 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8ee857ee-72f0-4d75-b5d4-48ac19ceab8f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:25.371122 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8ee857ee-72f0-4d75-b5d4-48ac19ceab8f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:25.380719 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:25.383365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ee857ee-72f0-4d75-b5d4-48ac19ceab8f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:25.384215 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ee857ee-72f0-4d75-b5d4-48ac19ceab8f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:25.385390 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ee857ee-72f0-4d75-b5d4-48ac19ceab8f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:25.386239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ee857ee-72f0-4d75-b5d4-48ac19ceab8f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:25.497883 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-8ee857ee-72f0-4d75-b5d4-48ac19ceab8f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lazy-loading 'services' on Instance uuid 9dafd3dc-6a6c-4a96-854d-e380a187a72b {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:50:25.688705 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-abc61dd3-269b-4bda-98e7-0022761c425a tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:25.689141 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-abc61dd3-269b-4bda-98e7-0022761c425a tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:25.693290 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:25.701999 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-abc61dd3-269b-4bda-98e7-0022761c425a tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:25.702441 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-abc61dd3-269b-4bda-98e7-0022761c425a tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:25.703264 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-abc61dd3-269b-4bda-98e7-0022761c425a tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:25.704835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-abc61dd3-269b-4bda-98e7-0022761c425a tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:25.743108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8ee857ee-72f0-4d75-b5d4-48ac19ceab8f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments/fa45e85a-209e-4b36-a603-ef27b2585598" status: 202 len: 0 microversion: 2.1 time: 0.376659 Jun 23 22:50:25.743729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 333/655] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:50:25 2022] DELETE /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments/fa45e85a-209e-4b36-a603-ef27b2585598 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:50:25.756566 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-882bacb7-54b6-45d2-b96a-376ad3779fe2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:25.758322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-882bacb7-54b6-45d2-b96a-376ad3779fe2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:25.774860 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-882bacb7-54b6-45d2-b96a-376ad3779fe2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:25.775463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-882bacb7-54b6-45d2-b96a-376ad3779fe2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:25.776717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-882bacb7-54b6-45d2-b96a-376ad3779fe2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:25.777437 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-882bacb7-54b6-45d2-b96a-376ad3779fe2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:25.817798 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-882bacb7-54b6-45d2-b96a-376ad3779fe2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069359 Jun 23 22:50:25.819609 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 334/656] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:50:25 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:50:25.837653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-abc61dd3-269b-4bda-98e7-0022761c425a tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:25.863793 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-abc61dd3-269b-4bda-98e7-0022761c425a tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1210 microversion: 2.1 time: 0.179420 Jun 23 22:50:25.869094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 323/657] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:25 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1210 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:26.881888 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-67f27192-6657-40f9-b3e9-47a0a903f613 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:26.882568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-67f27192-6657-40f9-b3e9-47a0a903f613 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:26.901522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67f27192-6657-40f9-b3e9-47a0a903f613 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:26.901978 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67f27192-6657-40f9-b3e9-47a0a903f613 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:26.902750 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67f27192-6657-40f9-b3e9-47a0a903f613 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:26.908674 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-67f27192-6657-40f9-b3e9-47a0a903f613 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:27.082695 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-479868d0-27de-464c-bbde-29466ee29011 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:27.083766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-479868d0-27de-464c-bbde-29466ee29011 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:27.090812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-479868d0-27de-464c-bbde-29466ee29011 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:27.091564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-479868d0-27de-464c-bbde-29466ee29011 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:27.092594 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-479868d0-27de-464c-bbde-29466ee29011 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:27.093257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-479868d0-27de-464c-bbde-29466ee29011 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:27.128112 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-479868d0-27de-464c-bbde-29466ee29011 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.301453 Jun 23 22:50:27.130171 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 335/658] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:50:26 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments => generated 197 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:27.387428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-67f27192-6657-40f9-b3e9-47a0a903f613 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:27.404220 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-67f27192-6657-40f9-b3e9-47a0a903f613 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.525897 Jun 23 22:50:27.404834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 324/659] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:26 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:28.141757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4b163bf1-adbf-4a12-a69d-3ca27eff57c0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:28.144281 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4b163bf1-adbf-4a12-a69d-3ca27eff57c0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:28.151605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4b163bf1-adbf-4a12-a69d-3ca27eff57c0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.152392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4b163bf1-adbf-4a12-a69d-3ca27eff57c0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.153567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4b163bf1-adbf-4a12-a69d-3ca27eff57c0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.154040 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4b163bf1-adbf-4a12-a69d-3ca27eff57c0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.223457 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4b163bf1-adbf-4a12-a69d-3ca27eff57c0 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086726 Jun 23 22:50:28.224240 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 336/660] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:50:28 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:50:28.302711 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6e4fc960-b7d3-478c-8c41-6482e8c718be tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:28.303247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6e4fc960-b7d3-478c-8c41-6482e8c718be tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:28.310716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e4fc960-b7d3-478c-8c41-6482e8c718be tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.311514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e4fc960-b7d3-478c-8c41-6482e8c718be tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.312257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e4fc960-b7d3-478c-8c41-6482e8c718be tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.312794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e4fc960-b7d3-478c-8c41-6482e8c718be tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.350664 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6e4fc960-b7d3-478c-8c41-6482e8c718be tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:50:28.382137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-56c0db41-9397-4607-80b7-1abe3bd01df8 req-1a8f20d5-6359-4bef-81a2-961b3d2a5c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc6a308-2725-417e-8596-d39f57306af5", "tag": "407cf8de-21c5-4a4d-8db2-9d64ac13fb20"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:28.399709 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-56c0db41-9397-4607-80b7-1abe3bd01df8 req-1a8f20d5-6359-4bef-81a2-961b3d2a5c4a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.400152 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-56c0db41-9397-4607-80b7-1abe3bd01df8 req-1a8f20d5-6359-4bef-81a2-961b3d2a5c4a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.419087 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-56c0db41-9397-4607-80b7-1abe3bd01df8 req-1a8f20d5-6359-4bef-81a2-961b3d2a5c4a service nova] Creating event network-changed:407cf8de-21c5-4a4d-8db2-9d64ac13fb20 for instance 5dc6a308-2725-417e-8596-d39f57306af5 on hv-cinder-81322 Jun 23 22:50:28.424257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-56c0db41-9397-4607-80b7-1abe3bd01df8 req-1a8f20d5-6359-4bef-81a2-961b3d2a5c4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045835 Jun 23 22:50:28.425534 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 337/661] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:28.439844 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-72e5d0ce-715e-4222-adc8-787cf807e244 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:28.441194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-72e5d0ce-715e-4222-adc8-787cf807e244 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:28.448326 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72e5d0ce-715e-4222-adc8-787cf807e244 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.448859 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72e5d0ce-715e-4222-adc8-787cf807e244 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.456159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72e5d0ce-715e-4222-adc8-787cf807e244 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.457521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-72e5d0ce-715e-4222-adc8-787cf807e244 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.663026 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6e4fc960-b7d3-478c-8c41-6482e8c718be tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 204 len: 0 microversion: 2.1 time: 0.363606 Jun 23 22:50:28.663628 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 325/662] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:50:28 2022] DELETE /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:50:28.677836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-72e5d0ce-715e-4222-adc8-787cf807e244 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:28.697057 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-72e5d0ce-715e-4222-adc8-787cf807e244 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.260188 Jun 23 22:50:28.697057 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 338/663] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:28 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:28.697057 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0240bfc1-3cc2-446b-8c40-16534827d8ea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:28.697057 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0240bfc1-3cc2-446b-8c40-16534827d8ea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:28.702363 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0240bfc1-3cc2-446b-8c40-16534827d8ea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.703071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0240bfc1-3cc2-446b-8c40-16534827d8ea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.704371 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0240bfc1-3cc2-446b-8c40-16534827d8ea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.705707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0240bfc1-3cc2-446b-8c40-16534827d8ea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.888673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b41829be-9121-440e-9d8c-cb37299b87a0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:28.889271 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b41829be-9121-440e-9d8c-cb37299b87a0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:28.897533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b41829be-9121-440e-9d8c-cb37299b87a0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.898174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b41829be-9121-440e-9d8c-cb37299b87a0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.899110 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b41829be-9121-440e-9d8c-cb37299b87a0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:28.899701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b41829be-9121-440e-9d8c-cb37299b87a0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:28.945220 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b41829be-9121-440e-9d8c-cb37299b87a0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/ips" status: 200 len: 148 microversion: 2.1 time: 0.273097 Jun 23 22:50:28.947499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 326/664] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:50:28 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/ips => generated 148 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:28.967089 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0240bfc1-3cc2-446b-8c40-16534827d8ea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:28.976898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0240bfc1-3cc2-446b-8c40-16534827d8ea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1690 microversion: 2.1 time: 0.287366 Jun 23 22:50:28.979271 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 339/665] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:28 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1690 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:29.704285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ef857462-2ff5-4af0-845d-8f6d7e5f8e6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:29.704992 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ef857462-2ff5-4af0-845d-8f6d7e5f8e6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:29.718854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef857462-2ff5-4af0-845d-8f6d7e5f8e6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:29.718854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef857462-2ff5-4af0-845d-8f6d7e5f8e6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:29.718854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef857462-2ff5-4af0-845d-8f6d7e5f8e6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:29.718854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef857462-2ff5-4af0-845d-8f6d7e5f8e6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:29.858447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ef857462-2ff5-4af0-845d-8f6d7e5f8e6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:29.866225 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ef857462-2ff5-4af0-845d-8f6d7e5f8e6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.165876 Jun 23 22:50:29.866785 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 327/666] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:29 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:29.995287 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-34c1565f-274a-4d2c-9d13-5806b3b37a40 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:29.996441 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-34c1565f-274a-4d2c-9d13-5806b3b37a40 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:30.003643 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-34c1565f-274a-4d2c-9d13-5806b3b37a40 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:30.004096 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-34c1565f-274a-4d2c-9d13-5806b3b37a40 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:30.005388 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-34c1565f-274a-4d2c-9d13-5806b3b37a40 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:30.005766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-34c1565f-274a-4d2c-9d13-5806b3b37a40 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:30.155922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-34c1565f-274a-4d2c-9d13-5806b3b37a40 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:30.171601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-34c1565f-274a-4d2c-9d13-5806b3b37a40 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1690 microversion: 2.1 time: 0.172751 Jun 23 22:50:30.171601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 340/667] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:29 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1690 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:30.670647 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eebcce38-8f56-437f-a2d7-50ec5716a66d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d236c29b-4199-41ca-b49e-162ff4d6ba4b"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:30.671799 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-eebcce38-8f56-437f-a2d7-50ec5716a66d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:30.686426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eebcce38-8f56-437f-a2d7-50ec5716a66d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:30.687107 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eebcce38-8f56-437f-a2d7-50ec5716a66d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:30.688077 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eebcce38-8f56-437f-a2d7-50ec5716a66d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:30.688710 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eebcce38-8f56-437f-a2d7-50ec5716a66d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:30.883427 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ed54ec45-1018-4ddb-a6b4-35cd89459d6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:30.884113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ed54ec45-1018-4ddb-a6b4-35cd89459d6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:30.894346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed54ec45-1018-4ddb-a6b4-35cd89459d6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:30.894811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed54ec45-1018-4ddb-a6b4-35cd89459d6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:30.895800 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed54ec45-1018-4ddb-a6b4-35cd89459d6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:30.896472 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed54ec45-1018-4ddb-a6b4-35cd89459d6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:31.074890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ed54ec45-1018-4ddb-a6b4-35cd89459d6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:31.084180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ed54ec45-1018-4ddb-a6b4-35cd89459d6b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.204983 Jun 23 22:50:31.086468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 341/668] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:30 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:31.181912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b14aca68-ee41-4ca5-ac34-d1aeb3cda88e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:31.182514 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b14aca68-ee41-4ca5-ac34-d1aeb3cda88e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:31.192195 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b14aca68-ee41-4ca5-ac34-d1aeb3cda88e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:31.201430 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b14aca68-ee41-4ca5-ac34-d1aeb3cda88e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:31.205540 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b14aca68-ee41-4ca5-ac34-d1aeb3cda88e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:31.206201 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b14aca68-ee41-4ca5-ac34-d1aeb3cda88e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:31.412235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b14aca68-ee41-4ca5-ac34-d1aeb3cda88e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:31.421176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b14aca68-ee41-4ca5-ac34-d1aeb3cda88e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1690 microversion: 2.1 time: 0.243221 Jun 23 22:50:31.422350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 342/669] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:31 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1690 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:32.103321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c2486232-0009-4048-8351-a91f51c95a50 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:32.104822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c2486232-0009-4048-8351-a91f51c95a50 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:32.108836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:32.109060 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:32.115970 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2486232-0009-4048-8351-a91f51c95a50 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:32.116636 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2486232-0009-4048-8351-a91f51c95a50 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:32.117715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2486232-0009-4048-8351-a91f51c95a50 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:32.118602 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2486232-0009-4048-8351-a91f51c95a50 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:32.351660 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c2486232-0009-4048-8351-a91f51c95a50 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:32.361548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c2486232-0009-4048-8351-a91f51c95a50 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.261893 Jun 23 22:50:32.365924 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 343/670] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:32 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:32.375555 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:32.438861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-629b00fd-422f-4cb0-9227-517c43afa8f5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:32.439496 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-629b00fd-422f-4cb0-9227-517c43afa8f5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:32.463784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-629b00fd-422f-4cb0-9227-517c43afa8f5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:32.464539 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-629b00fd-422f-4cb0-9227-517c43afa8f5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:32.465532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-629b00fd-422f-4cb0-9227-517c43afa8f5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:32.466134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-629b00fd-422f-4cb0-9227-517c43afa8f5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:32.732284 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-629b00fd-422f-4cb0-9227-517c43afa8f5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:32.748542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-629b00fd-422f-4cb0-9227-517c43afa8f5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1690 microversion: 2.1 time: 0.313471 Jun 23 22:50:32.749764 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 344/671] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:32 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1690 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:32.752796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-eebcce38-8f56-437f-a2d7-50ec5716a66d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.085992 Jun 23 22:50:32.754204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 328/672] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:50:30 2022] POST /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments => generated 194 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:33.382695 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e09154ee-a744-4f5a-8ad2-72a83ebfc90d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:33.384174 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e09154ee-a744-4f5a-8ad2-72a83ebfc90d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:33.406856 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e09154ee-a744-4f5a-8ad2-72a83ebfc90d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:33.407595 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e09154ee-a744-4f5a-8ad2-72a83ebfc90d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:33.409031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e09154ee-a744-4f5a-8ad2-72a83ebfc90d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:33.414789 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e09154ee-a744-4f5a-8ad2-72a83ebfc90d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:33.616402 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e09154ee-a744-4f5a-8ad2-72a83ebfc90d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:33.625471 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e09154ee-a744-4f5a-8ad2-72a83ebfc90d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.246862 Jun 23 22:50:33.626260 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 345/673] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:33 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:33.767974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b1daa1b3-6da4-4287-a3a6-877e571b8a8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:33.769953 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b1daa1b3-6da4-4287-a3a6-877e571b8a8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:33.781181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b1daa1b3-6da4-4287-a3a6-877e571b8a8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:33.783880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b1daa1b3-6da4-4287-a3a6-877e571b8a8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:33.785905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b1daa1b3-6da4-4287-a3a6-877e571b8a8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:33.788202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b1daa1b3-6da4-4287-a3a6-877e571b8a8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:33.904349 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b1daa1b3-6da4-4287-a3a6-877e571b8a8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:33.916495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b1daa1b3-6da4-4287-a3a6-877e571b8a8d tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1623 microversion: 2.1 time: 0.152948 Jun 23 22:50:33.928405 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 329/674] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:33 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1623 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:34.097258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-9813a8e7-72ab-4730-a29a-71abb20e8746 req-7b3a6a67-7e85-4b3f-b3a2-1b804765017c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dafd3dc-6a6c-4a96-854d-e380a187a72b", "name": "network-vif-deleted", "tag": "605d9a1c-2adc-425e-a04a-51601319bff5"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:34.097258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-9813a8e7-72ab-4730-a29a-71abb20e8746 req-7b3a6a67-7e85-4b3f-b3a2-1b804765017c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:34.097258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-9813a8e7-72ab-4730-a29a-71abb20e8746 req-7b3a6a67-7e85-4b3f-b3a2-1b804765017c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:34.097258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:34.106218 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-9813a8e7-72ab-4730-a29a-71abb20e8746 req-7b3a6a67-7e85-4b3f-b3a2-1b804765017c service nova] Creating event network-vif-deleted:605d9a1c-2adc-425e-a04a-51601319bff5 for instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b on hv-cinder-81322 Jun 23 22:50:34.113511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-9813a8e7-72ab-4730-a29a-71abb20e8746 req-7b3a6a67-7e85-4b3f-b3a2-1b804765017c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038315 Jun 23 22:50:34.114279 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 346/675] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:34.643119 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-71626fd7-1e2b-4a64-98ed-0b4912c40aac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:34.647144 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-71626fd7-1e2b-4a64-98ed-0b4912c40aac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:34.658473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71626fd7-1e2b-4a64-98ed-0b4912c40aac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:34.658473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71626fd7-1e2b-4a64-98ed-0b4912c40aac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:34.658473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71626fd7-1e2b-4a64-98ed-0b4912c40aac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:34.658473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-71626fd7-1e2b-4a64-98ed-0b4912c40aac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:34.685371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:34.832905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-71626fd7-1e2b-4a64-98ed-0b4912c40aac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:34.841799 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-71626fd7-1e2b-4a64-98ed-0b4912c40aac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.202604 Jun 23 22:50:34.853026 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 330/676] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:34 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:34.936262 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:34.936983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:34.947914 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:34.948360 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:34.949160 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:34.949768 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:34.992595 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:34.993307 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:34.993913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lazy-loading 'fault' on Instance uuid 9dafd3dc-6a6c-4a96-854d-e380a187a72b {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:50:35.040519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:35.055479 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-10c66fba-0aa0-4910-afe9-21a05b688cb9 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 200 len: 1336 microversion: 2.1 time: 0.124098 Jun 23 22:50:35.056421 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 347/677] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:34 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:35.859226 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0db843e2-6d1e-4006-8205-fc6e88709b0d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:35.859869 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0db843e2-6d1e-4006-8205-fc6e88709b0d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:35.870358 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0db843e2-6d1e-4006-8205-fc6e88709b0d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:35.870813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0db843e2-6d1e-4006-8205-fc6e88709b0d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:35.871588 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0db843e2-6d1e-4006-8205-fc6e88709b0d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:35.872023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0db843e2-6d1e-4006-8205-fc6e88709b0d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:36.019361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0db843e2-6d1e-4006-8205-fc6e88709b0d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:36.030149 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0db843e2-6d1e-4006-8205-fc6e88709b0d tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.174712 Jun 23 22:50:36.040737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 331/678] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:35 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:36.072397 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:36.073202 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 9dafd3dc-6a6c-4a96-854d-e380a187a72b] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:36.079926 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:36.080610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:36.081577 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:36.082171 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:36.100790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] HTTP exception thrown: Instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b could not be found. Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Request method failure captured: Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b HTTP/1.1 Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0Fxgf8_W6nHzji-QVv9jKiLp4rg6lH_y6-T4g881cdcaBRhykJO0GrB4dCqu9pFmtp2fywc254ujM1yS_W8gisUumxZqIVtBkou9tpTQgKGhiSBP4vuty0nKCS6oCe-_37EzZxMUls-mnqqoz3G_53dfhEX2AvYPxQ_-nmCoCt624 Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:50:36.102934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_19ed20d55acb41fcb18006919476bf80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 675d117397da452faa5221af0906fb12 Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b could not be found. Jun 23 22:50:36.104597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '9dafd3dc-6a6c-4a96-854d-e380a187a72b'} Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b could not be found. Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:50:36.105530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b could not be found. Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b could not be found. Jun 23 22:50:36.107141 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:36.109511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Returning 404 to user: Instance 9dafd3dc-6a6c-4a96-854d-e380a187a72b could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:50:36.110558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0e214ba7-47b7-4918-aff2-1492f77e3ba6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b" status: 404 len: 111 microversion: 2.1 time: 0.042022 Jun 23 22:50:36.111860 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 348/679] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:36 2022] GET /compute/v2.1/servers/9dafd3dc-6a6c-4a96-854d-e380a187a72b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:50:36.121279 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7fb3b700-c4e7-4ccb-9ad6-75cdb627a410 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '.version_select at 0x7fbbcabc4dc0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:36.221108 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7fb3b700-c4e7-4ccb-9ad6-75cdb627a410 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107818852" status: 202 len: 0 microversion: 2.1 time: 0.103745 Jun 23 22:50:36.222896 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 332/680] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 23 22:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107818852 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:50:37.050828 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-58d3a701-f5f0-4bb4-84ec-504b32279599 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:37.051694 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-58d3a701-f5f0-4bb4-84ec-504b32279599 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:37.069272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-58d3a701-f5f0-4bb4-84ec-504b32279599 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:37.069272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-58d3a701-f5f0-4bb4-84ec-504b32279599 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:37.069272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-58d3a701-f5f0-4bb4-84ec-504b32279599 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:37.069272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-58d3a701-f5f0-4bb4-84ec-504b32279599 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:37.229416 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-58d3a701-f5f0-4bb4-84ec-504b32279599 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:37.237671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-58d3a701-f5f0-4bb4-84ec-504b32279599 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.194030 Jun 23 22:50:37.238377 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 349/681] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:37 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:38.256239 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-33b98ffb-cd26-49b8-88ca-9e1d8d60e7d4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:38.257014 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-33b98ffb-cd26-49b8-88ca-9e1d8d60e7d4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:38.263925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33b98ffb-cd26-49b8-88ca-9e1d8d60e7d4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:38.264569 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33b98ffb-cd26-49b8-88ca-9e1d8d60e7d4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:38.265534 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33b98ffb-cd26-49b8-88ca-9e1d8d60e7d4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:38.266174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-33b98ffb-cd26-49b8-88ca-9e1d8d60e7d4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:38.426942 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-33b98ffb-cd26-49b8-88ca-9e1d8d60e7d4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:38.435440 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-33b98ffb-cd26-49b8-88ca-9e1d8d60e7d4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.184415 Jun 23 22:50:38.436015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 333/682] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:38 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:39.453217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e8c81208-755a-4631-a50b-a282993aef72 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:39.454596 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e8c81208-755a-4631-a50b-a282993aef72 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:39.462933 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8c81208-755a-4631-a50b-a282993aef72 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:39.466256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8c81208-755a-4631-a50b-a282993aef72 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:39.466256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8c81208-755a-4631-a50b-a282993aef72 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:39.466256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8c81208-755a-4631-a50b-a282993aef72 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:39.614091 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e8c81208-755a-4631-a50b-a282993aef72 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:39.622647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e8c81208-755a-4631-a50b-a282993aef72 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.173860 Jun 23 22:50:39.623658 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 350/683] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:39 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:40.032884 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6e1c763e-8796-4078-b720-5dbb33a1f129 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:40.033417 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6e1c763e-8796-4078-b720-5dbb33a1f129 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:40.040526 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e1c763e-8796-4078-b720-5dbb33a1f129 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:40.041104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e1c763e-8796-4078-b720-5dbb33a1f129 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:40.041941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e1c763e-8796-4078-b720-5dbb33a1f129 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:40.042456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e1c763e-8796-4078-b720-5dbb33a1f129 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:40.071865 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6e1c763e-8796-4078-b720-5dbb33a1f129 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:50:40.471368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6e1c763e-8796-4078-b720-5dbb33a1f129 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 204 len: 0 microversion: 2.1 time: 0.442095 Jun 23 22:50:40.473044 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 334/684] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:50:40 2022] DELETE /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:50:40.481225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5c62afb6-e8c5-4844-99b6-cb75b3aa4599 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:40.481838 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5c62afb6-e8c5-4844-99b6-cb75b3aa4599 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:40.489452 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5c62afb6-e8c5-4844-99b6-cb75b3aa4599 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:40.489911 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5c62afb6-e8c5-4844-99b6-cb75b3aa4599 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:40.490676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5c62afb6-e8c5-4844-99b6-cb75b3aa4599 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:40.491118 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5c62afb6-e8c5-4844-99b6-cb75b3aa4599 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:40.619470 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5c62afb6-e8c5-4844-99b6-cb75b3aa4599 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:40.627051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5c62afb6-e8c5-4844-99b6-cb75b3aa4599 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1506 microversion: 2.1 time: 0.149627 Jun 23 22:50:40.627605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 351/685] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:40 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:40.648120 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-58dbfbd1-bf8d-4eae-b7ec-185b4b3b7bd0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:40.648840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-58dbfbd1-bf8d-4eae-b7ec-185b4b3b7bd0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:40.654850 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58dbfbd1-bf8d-4eae-b7ec-185b4b3b7bd0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:40.655298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58dbfbd1-bf8d-4eae-b7ec-185b4b3b7bd0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:40.656040 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58dbfbd1-bf8d-4eae-b7ec-185b4b3b7bd0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:40.656468 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-58dbfbd1-bf8d-4eae-b7ec-185b4b3b7bd0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:40.797770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-58dbfbd1-bf8d-4eae-b7ec-185b4b3b7bd0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:40.805450 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-58dbfbd1-bf8d-4eae-b7ec-185b4b3b7bd0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.168151 Jun 23 22:50:40.806036 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 335/686] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:40 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:41.644656 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0e06461b-d3d9-47a8-8b3f-f294cc0a12f8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:41.645476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0e06461b-d3d9-47a8-8b3f-f294cc0a12f8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:41.652038 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e06461b-d3d9-47a8-8b3f-f294cc0a12f8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:41.652494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e06461b-d3d9-47a8-8b3f-f294cc0a12f8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:41.653339 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e06461b-d3d9-47a8-8b3f-f294cc0a12f8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:41.653765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e06461b-d3d9-47a8-8b3f-f294cc0a12f8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:41.701187 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-62a56e99-13e8-41e4-a11e-55db7b6e194a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Action: 'create', calling method: .version_select at 0x7fbbca20d3a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1500613934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqKfO9CoFbngBsV5kM1Lqfbq1mftye8wqRuE2DTauwyNM3Tm7d8jE4q5xTb6LWg2FOo+xwFYAHsyOpWZfCKOCwYK5J8tVLAL7vI0f2+KVUKYaaNG3VYb9pVPvuqLd+cBg=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:41.715987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-62a56e99-13e8-41e4-a11e-55db7b6e194a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Getting quotas for project e3f62d8ed71b424f8414e9c3eaa681aa. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:50:41.719695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-62a56e99-13e8-41e4-a11e-55db7b6e194a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Getting quotas for user e6a2de8d5a514a73aa4e136b7afee9c2 and project e3f62d8ed71b424f8414e9c3eaa681aa. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:50:41.784007 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0e06461b-d3d9-47a8-8b3f-f294cc0a12f8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:41.790693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-62a56e99-13e8-41e4-a11e-55db7b6e194a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.092925 Jun 23 22:50:41.791433 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 336/687] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:50:41 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:50:41.792425 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0e06461b-d3d9-47a8-8b3f-f294cc0a12f8 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1506 microversion: 2.1 time: 0.152108 Jun 23 22:50:41.793190 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 352/688] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:41 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:41.822522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fbb9ce15-88ec-4b90-8237-48379d518320 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:41.823050 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fbb9ce15-88ec-4b90-8237-48379d518320 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:41.829045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbb9ce15-88ec-4b90-8237-48379d518320 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:41.829496 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbb9ce15-88ec-4b90-8237-48379d518320 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:41.830252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbb9ce15-88ec-4b90-8237-48379d518320 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:41.830683 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fbb9ce15-88ec-4b90-8237-48379d518320 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:41.842034 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1717997833", "imageRef": "5d8114bc-3761-4d84-a704-d593e769ef05", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1500613934", "networks": [{"uuid": "70f0a602-f044-483e-892d-193a90a9b63c"}]}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:41.897000 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.network.neutron [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] validate_networks() for [('70f0a602-f044-483e-892d-193a90a9b63c', None, None, None, None, None)] {{(pid=124724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:50:41.988409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fbb9ce15-88ec-4b90-8237-48379d518320 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:41.996234 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fbb9ce15-88ec-4b90-8237-48379d518320 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.177995 Jun 23 22:50:41.996958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 337/689] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:41 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:42.375504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Flavor limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:50:42.375924 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Image limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:50:42.376387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Flavor pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:50:42.376817 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Image pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:50:42.377224 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:50:42.386608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:42.387051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:42.387834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:42.388265 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:42.405078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Getting quotas for project e3f62d8ed71b424f8414e9c3eaa681aa. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:50:42.408939 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Getting quotas for user e6a2de8d5a514a73aa4e136b7afee9c2 and project e3f62d8ed71b424f8414e9c3eaa681aa. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:50:42.420175 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Going to run 1 instances... {{(pid=124724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:50:42.422338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d8114bc-3761-4d84-a704-d593e769ef05',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:50:42.537880 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ffe5bba9-e4f9-4cd1-8cfe-75311bc038f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699562 Jun 23 22:50:42.538689 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 353/690] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:50:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 22:50:42.548262 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bdd97912-8441-4878-bc00-c89d7ed33a1c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:42.548898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bdd97912-8441-4878-bc00-c89d7ed33a1c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:42.602848 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bdd97912-8441-4878-bc00-c89d7ed33a1c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:42.609746 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bdd97912-8441-4878-bc00-c89d7ed33a1c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1259 microversion: 2.1 time: 0.065272 Jun 23 22:50:42.610893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 338/691] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:42 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1259 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:42.810452 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a7679a85-4fab-470a-a7d1-cba30b4fd9b5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:42.811137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a7679a85-4fab-470a-a7d1-cba30b4fd9b5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:42.820879 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a7679a85-4fab-470a-a7d1-cba30b4fd9b5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:42.821325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a7679a85-4fab-470a-a7d1-cba30b4fd9b5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:42.822114 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a7679a85-4fab-470a-a7d1-cba30b4fd9b5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:42.822519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a7679a85-4fab-470a-a7d1-cba30b4fd9b5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:42.961523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a7679a85-4fab-470a-a7d1-cba30b4fd9b5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:42.971935 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a7679a85-4fab-470a-a7d1-cba30b4fd9b5 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1506 microversion: 2.1 time: 0.164898 Jun 23 22:50:42.976914 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 354/692] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:42 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:43.012962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-64b1376d-67d9-4c94-86b8-8151629f986e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:43.013576 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-64b1376d-67d9-4c94-86b8-8151629f986e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:43.025178 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64b1376d-67d9-4c94-86b8-8151629f986e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:43.025178 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64b1376d-67d9-4c94-86b8-8151629f986e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:43.025178 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64b1376d-67d9-4c94-86b8-8151629f986e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:43.025178 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64b1376d-67d9-4c94-86b8-8151629f986e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:43.159853 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-64b1376d-67d9-4c94-86b8-8151629f986e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:43.167679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-64b1376d-67d9-4c94-86b8-8151629f986e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.158624 Jun 23 22:50:43.168257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 339/693] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:43 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:43.611079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d236c29b-4199-41ca-b49e-162ff4d6ba4b"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:43.612194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:43.618766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:43.619217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:43.619982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:43.620444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:43.627068 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7248e666-9d0c-4e19-affd-451551022262 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:43.627911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7248e666-9d0c-4e19-affd-451551022262 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:43.696958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7248e666-9d0c-4e19-affd-451551022262 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:43.702974 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Invalid volume: volume d236c29b-4199-41ca-b49e-162ff4d6ba4b is already attached to instances: 49d70e57-0b2f-40c0-92c9-ff20698a0de0 Jun 23 22:50:43.703682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7248e666-9d0c-4e19-affd-451551022262 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1259 microversion: 2.1 time: 0.080614 Jun 23 22:50:43.704351 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 340/694] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:43 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: POST /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments HTTP/1.1 Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 74 Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:50:43.710611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {"volumeAttachment": {"volumeId": "d236c29b-4199-41ca-b49e-162ff4d6ba4b"}} Jun 23 22:50:43.712185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Invalid volume: volume d236c29b-4199-41ca-b49e-162ff4d6ba4b is already attached to instances: 49d70e57-0b2f-40c0-92c9-ff20698a0de0 Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'server_id': '49d70e57-0b2f-40c0-92c9-ff20698a0de0', 'body': {'volumeAttachment': {'volumeId': 'd236c29b-4199-41ca-b49e-162ff4d6ba4b'}}} Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d236c29b-4199-41ca-b49e-162ff4d6ba4b is already attached to instances: 49d70e57-0b2f-40c0-92c9-ff20698a0de0 Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:43.713094 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d236c29b-4199-41ca-b49e-162ff4d6ba4b is already attached to instances: 49d70e57-0b2f-40c0-92c9-ff20698a0de0 Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:43.714523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:43.716194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:43.716194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:50:43.716194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:50:43.716194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d236c29b-4199-41ca-b49e-162ff4d6ba4b is already attached to instances: 49d70e57-0b2f-40c0-92c9-ff20698a0de0 Jun 23 22:50:43.716194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:50:43.716194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 400 to user: Invalid volume: volume d236c29b-4199-41ca-b49e-162ff4d6ba4b is already attached to instances: 49d70e57-0b2f-40c0-92c9-ff20698a0de0 {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:50:43.716194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9c0f4041-d694-4f75-9d2a-5bf8559f6e9f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099400 Jun 23 22:50:43.716194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 355/695] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:50:43 2022] POST /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:50:43.773217 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-daf3e168-b68f-47ee-8672-bb6aca793d93 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:43.773709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-daf3e168-b68f-47ee-8672-bb6aca793d93 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:43.779715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf3e168-b68f-47ee-8672-bb6aca793d93 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:43.780158 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf3e168-b68f-47ee-8672-bb6aca793d93 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:43.780941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf3e168-b68f-47ee-8672-bb6aca793d93 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:43.781377 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-daf3e168-b68f-47ee-8672-bb6aca793d93 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:43.870209 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-daf3e168-b68f-47ee-8672-bb6aca793d93 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lazy-loading 'services' on Instance uuid 49d70e57-0b2f-40c0-92c9-ff20698a0de0 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:50:43.966686 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-9d0b31bb-f435-4b47-8ab8-3e0bd45cf42a req-b42569fe-bdc7-489b-bfb3-011a30973e80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7185d851-3beb-40db-9d52-d401b0db2367", "name": "network-vif-deleted", "tag": "ef90cb7d-19ed-4cbb-8b5b-b499ea919109"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:43.977194 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-9d0b31bb-f435-4b47-8ab8-3e0bd45cf42a req-b42569fe-bdc7-489b-bfb3-011a30973e80 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:43.977634 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-9d0b31bb-f435-4b47-8ab8-3e0bd45cf42a req-b42569fe-bdc7-489b-bfb3-011a30973e80 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:43.989359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-9d0b31bb-f435-4b47-8ab8-3e0bd45cf42a req-b42569fe-bdc7-489b-bfb3-011a30973e80 service nova] Creating event network-vif-deleted:ef90cb7d-19ed-4cbb-8b5b-b499ea919109 for instance 7185d851-3beb-40db-9d52-d401b0db2367 on hv-cinder-81322 Jun 23 22:50:43.994500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-9d0b31bb-f435-4b47-8ab8-3e0bd45cf42a req-b42569fe-bdc7-489b-bfb3-011a30973e80 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031657 Jun 23 22:50:43.995214 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 356/696] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:50:44.001351 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3e5a24b4-a830-4d7c-a0e5-d03ee8669795 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:44.002127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3e5a24b4-a830-4d7c-a0e5-d03ee8669795 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:44.012299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e5a24b4-a830-4d7c-a0e5-d03ee8669795 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.012906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e5a24b4-a830-4d7c-a0e5-d03ee8669795 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.013736 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e5a24b4-a830-4d7c-a0e5-d03ee8669795 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.016348 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e5a24b4-a830-4d7c-a0e5-d03ee8669795 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.087439 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3e5a24b4-a830-4d7c-a0e5-d03ee8669795 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:44.096224 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3e5a24b4-a830-4d7c-a0e5-d03ee8669795 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1464 microversion: 2.1 time: 0.099054 Jun 23 22:50:44.097114 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 357/697] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:43 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:44.102048 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-daf3e168-b68f-47ee-8672-bb6aca793d93 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments/d236c29b-4199-41ca-b49e-162ff4d6ba4b" status: 202 len: 0 microversion: 2.1 time: 0.333160 Jun 23 22:50:44.102927 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 341/698] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:50:43 2022] DELETE /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments/d236c29b-4199-41ca-b49e-162ff4d6ba4b => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:50:44.112312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ef35d198-1238-4a31-b876-c541e69f86f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:44.113660 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ef35d198-1238-4a31-b876-c541e69f86f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:44.120032 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef35d198-1238-4a31-b876-c541e69f86f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.120523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef35d198-1238-4a31-b876-c541e69f86f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.121422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef35d198-1238-4a31-b876-c541e69f86f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.122048 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ef35d198-1238-4a31-b876-c541e69f86f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.151015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-619a99ec-2b7e-4f55-8100-456520f23ec2 req-95a45c51-a783-4957-bf53-176d9532a525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc6a308-2725-417e-8596-d39f57306af5", "name": "network-vif-plugged", "status": "completed", "tag": "407cf8de-21c5-4a4d-8db2-9d64ac13fb20"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:44.154241 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ef35d198-1238-4a31-b876-c541e69f86f8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046231 Jun 23 22:50:44.155225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 358/699] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:50:44 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:44.162760 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-619a99ec-2b7e-4f55-8100-456520f23ec2 req-95a45c51-a783-4957-bf53-176d9532a525 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.163283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-619a99ec-2b7e-4f55-8100-456520f23ec2 req-95a45c51-a783-4957-bf53-176d9532a525 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.175199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-619a99ec-2b7e-4f55-8100-456520f23ec2 req-95a45c51-a783-4957-bf53-176d9532a525 service nova] Creating event network-vif-plugged:407cf8de-21c5-4a4d-8db2-9d64ac13fb20 for instance 5dc6a308-2725-417e-8596-d39f57306af5 on hv-cinder-81322 Jun 23 22:50:44.181539 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-619a99ec-2b7e-4f55-8100-456520f23ec2 req-95a45c51-a783-4957-bf53-176d9532a525 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Jun 23 22:50:44.181913 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 342/700] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:44.187013 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-baa8367a-182e-4c24-b01f-771bdbe2b1d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:44.187685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-baa8367a-182e-4c24-b01f-771bdbe2b1d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:44.195642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-baa8367a-182e-4c24-b01f-771bdbe2b1d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.196100 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-baa8367a-182e-4c24-b01f-771bdbe2b1d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.197089 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-baa8367a-182e-4c24-b01f-771bdbe2b1d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.197672 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-baa8367a-182e-4c24-b01f-771bdbe2b1d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.370343 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-baa8367a-182e-4c24-b01f-771bdbe2b1d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:44.380845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-baa8367a-182e-4c24-b01f-771bdbe2b1d9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.198419 Jun 23 22:50:44.381589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 359/701] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:44 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:44.721724 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1105e3bd-6a1e-4bad-9366-631e5005237d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:44.722733 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1105e3bd-6a1e-4bad-9366-631e5005237d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:44.729695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1105e3bd-6a1e-4bad-9366-631e5005237d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.730141 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1105e3bd-6a1e-4bad-9366-631e5005237d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.730893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1105e3bd-6a1e-4bad-9366-631e5005237d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:44.731332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1105e3bd-6a1e-4bad-9366-631e5005237d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:44.795589 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1105e3bd-6a1e-4bad-9366-631e5005237d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:44.803695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1105e3bd-6a1e-4bad-9366-631e5005237d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1311 microversion: 2.1 time: 0.086166 Jun 23 22:50:44.804251 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 343/702] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:44 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:45.115148 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:45.115744 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:45.122239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.122700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.123456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.123891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.153811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.154254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.154703 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lazy-loading 'fault' on Instance uuid 7185d851-3beb-40db-9d52-d401b0db2367 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:50:45.166457 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e6ae0308-65dd-47be-ade9-a2385212de2e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:45.167447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e6ae0308-65dd-47be-ade9-a2385212de2e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:45.173987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6ae0308-65dd-47be-ade9-a2385212de2e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.174436 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6ae0308-65dd-47be-ade9-a2385212de2e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.175905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6ae0308-65dd-47be-ade9-a2385212de2e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.176470 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e6ae0308-65dd-47be-ade9-a2385212de2e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.200943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:45.205809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-eeab51df-d9b6-4375-ba80-d6583725617e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 200 len: 1311 microversion: 2.1 time: 0.095195 Jun 23 22:50:45.207552 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 360/703] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:45 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:45.212807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e6ae0308-65dd-47be-ade9-a2385212de2e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049352 Jun 23 22:50:45.216634 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 344/704] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:50:45 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:50:45.398067 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-114b214e-1c55-4c6f-a903-6c449f583fac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:45.398599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-114b214e-1c55-4c6f-a903-6c449f583fac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:45.404877 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-114b214e-1c55-4c6f-a903-6c449f583fac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.405406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-114b214e-1c55-4c6f-a903-6c449f583fac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.405961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-114b214e-1c55-4c6f-a903-6c449f583fac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.406402 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-114b214e-1c55-4c6f-a903-6c449f583fac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.550239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-114b214e-1c55-4c6f-a903-6c449f583fac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:45.561897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-114b214e-1c55-4c6f-a903-6c449f583fac tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1266 microversion: 2.1 time: 0.168472 Jun 23 22:50:45.563269 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 361/705] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:45 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:45.821103 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3d036fa4-3e76-4e41-98a6-def31028513e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:45.821851 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3d036fa4-3e76-4e41-98a6-def31028513e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:45.828046 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d036fa4-3e76-4e41-98a6-def31028513e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.828492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d036fa4-3e76-4e41-98a6-def31028513e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.829318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d036fa4-3e76-4e41-98a6-def31028513e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:45.829753 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d036fa4-3e76-4e41-98a6-def31028513e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:45.904046 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3d036fa4-3e76-4e41-98a6-def31028513e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:45.913650 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3d036fa4-3e76-4e41-98a6-def31028513e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1329 microversion: 2.1 time: 0.096270 Jun 23 22:50:45.914941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 345/706] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:45 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:46.225772 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:46.226503 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 7185d851-3beb-40db-9d52-d401b0db2367] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:46.226780 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-be9d028b-e766-4ea0-ab60-f894fbae29ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:46.230039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-be9d028b-e766-4ea0-ab60-f894fbae29ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:46.233428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.233875 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.234633 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.234840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be9d028b-e766-4ea0-ab60-f894fbae29ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.235063 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.235297 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be9d028b-e766-4ea0-ab60-f894fbae29ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.236327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be9d028b-e766-4ea0-ab60-f894fbae29ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.236797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-be9d028b-e766-4ea0-ab60-f894fbae29ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.252961 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] HTTP exception thrown: Instance 7185d851-3beb-40db-9d52-d401b0db2367 could not be found. Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Request method failure captured: Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 HTTP/1.1 Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0Fxgf8_W6nHzji-QVv9jKiLp4rg6lH_y6-T4g881cdcaBRhykJO0GrB4dCqu9pFmtp2fywc254ujM1yS_W8gisUumxZqIVtBkou9tpTQgKGhiSBP4vuty0nKCS6oCe-_37EzZxMUls-mnqqoz3G_53dfhEX2AvYPxQ_-nmCoCt624 Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:50:46.258868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_19ed20d55acb41fcb18006919476bf80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 675d117397da452faa5221af0906fb12 Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 7185d851-3beb-40db-9d52-d401b0db2367 could not be found. Jun 23 22:50:46.260492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '7185d851-3beb-40db-9d52-d401b0db2367'} Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7185d851-3beb-40db-9d52-d401b0db2367 could not be found. Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:50:46.261463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7185d851-3beb-40db-9d52-d401b0db2367 could not be found. Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7185d851-3beb-40db-9d52-d401b0db2367 could not be found. Jun 23 22:50:46.262917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:50:46.264360 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Returning 404 to user: Instance 7185d851-3beb-40db-9d52-d401b0db2367 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:50:46.264360 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-06281170-3543-43a3-bccb-0e435524edb1 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367" status: 404 len: 111 microversion: 2.1 time: 0.035474 Jun 23 22:50:46.264360 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 346/707] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:46 2022] GET /compute/v2.1/servers/7185d851-3beb-40db-9d52-d401b0db2367 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:50:46.265362 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6d1cf629-470d-4cde-92ba-33df1632d555 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:46.265952 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6d1cf629-470d-4cde-92ba-33df1632d555 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:46.271859 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-be9d028b-e766-4ea0-ab60-f894fbae29ce tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050938 Jun 23 22:50:46.272753 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 362/708] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:50:46 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:50:46.286143 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d1cf629-470d-4cde-92ba-33df1632d555 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.295365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d1cf629-470d-4cde-92ba-33df1632d555 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.296356 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d1cf629-470d-4cde-92ba-33df1632d555 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.296829 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6d1cf629-470d-4cde-92ba-33df1632d555 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.329727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6d1cf629-470d-4cde-92ba-33df1632d555 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:50:46.349741 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-91c68cc9-cd19-40dd-9c7c-5741b587a868 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:46.350818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-91c68cc9-cd19-40dd-9c7c-5741b587a868 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:46.358603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-91c68cc9-cd19-40dd-9c7c-5741b587a868 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.359463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-91c68cc9-cd19-40dd-9c7c-5741b587a868 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.360362 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-91c68cc9-cd19-40dd-9c7c-5741b587a868 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.361188 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-91c68cc9-cd19-40dd-9c7c-5741b587a868 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.391848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-91c68cc9-cd19-40dd-9c7c-5741b587a868 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:50:46.436243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:46.646725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6d1cf629-470d-4cde-92ba-33df1632d555 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "DELETE /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 204 len: 0 microversion: 2.1 time: 0.384945 Jun 23 22:50:46.647612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 347/709] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:50:46 2022] DELETE /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:50:46.654003 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-22dd2819-6553-4040-8e81-385a50a149c3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:46.656707 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-22dd2819-6553-4040-8e81-385a50a149c3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:46.661128 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22dd2819-6553-4040-8e81-385a50a149c3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.661582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22dd2819-6553-4040-8e81-385a50a149c3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.662367 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22dd2819-6553-4040-8e81-385a50a149c3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.662804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22dd2819-6553-4040-8e81-385a50a149c3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.684640 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:46.735288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-91c68cc9-cd19-40dd-9c7c-5741b587a868 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 204 len: 0 microversion: 2.1 time: 0.389659 Jun 23 22:50:46.736329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 363/710] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:50:46 2022] DELETE /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:50:46.742484 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cfa0bc53-78bc-4c97-a380-660ca392338f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:46.744095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cfa0bc53-78bc-4c97-a380-660ca392338f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:46.749968 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfa0bc53-78bc-4c97-a380-660ca392338f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.750491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfa0bc53-78bc-4c97-a380-660ca392338f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.751451 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfa0bc53-78bc-4c97-a380-660ca392338f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.751905 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfa0bc53-78bc-4c97-a380-660ca392338f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.856439 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-22dd2819-6553-4040-8e81-385a50a149c3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:46.873774 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-22dd2819-6553-4040-8e81-385a50a149c3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1454 microversion: 2.1 time: 0.221006 Jun 23 22:50:46.886088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 348/711] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:46 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1454 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:46.891211 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3ae768b0-8b91-456f-a29e-7fbe4a166d8c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:46.891807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3ae768b0-8b91-456f-a29e-7fbe4a166d8c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:46.898821 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3ae768b0-8b91-456f-a29e-7fbe4a166d8c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.899265 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3ae768b0-8b91-456f-a29e-7fbe4a166d8c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.900028 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3ae768b0-8b91-456f-a29e-7fbe4a166d8c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.900462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3ae768b0-8b91-456f-a29e-7fbe4a166d8c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.947761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cfa0bc53-78bc-4c97-a380-660ca392338f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:46.955319 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cfa0bc53-78bc-4c97-a380-660ca392338f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.217649 Jun 23 22:50:46.955884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 364/712] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:46 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:46.960911 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ecabd249-e7ab-4abd-a642-36dbe0fa64d8 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:46.961504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ecabd249-e7ab-4abd-a642-36dbe0fa64d8 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:46.967576 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ecabd249-e7ab-4abd-a642-36dbe0fa64d8 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.968024 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ecabd249-e7ab-4abd-a642-36dbe0fa64d8 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:46.968809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ecabd249-e7ab-4abd-a642-36dbe0fa64d8 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:46.969242 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ecabd249-e7ab-4abd-a642-36dbe0fa64d8 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:47.116063 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3ae768b0-8b91-456f-a29e-7fbe4a166d8c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:47.127627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3ae768b0-8b91-456f-a29e-7fbe4a166d8c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.237092 Jun 23 22:50:47.128387 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 349/713] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:46 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:47.134767 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4824ffac-54a3-4862-98f6-fe11de597e3c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:47.135371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4824ffac-54a3-4862-98f6-fe11de597e3c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:47.135783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ecabd249-e7ab-4abd-a642-36dbe0fa64d8 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:47.145080 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ecabd249-e7ab-4abd-a642-36dbe0fa64d8 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1454 microversion: 2.1 time: 0.187441 Jun 23 22:50:47.146979 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 365/714] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:46 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:47.162804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4824ffac-54a3-4862-98f6-fe11de597e3c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:47.163261 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4824ffac-54a3-4862-98f6-fe11de597e3c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:47.164219 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4824ffac-54a3-4862-98f6-fe11de597e3c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:47.164695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4824ffac-54a3-4862-98f6-fe11de597e3c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:47.402626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4824ffac-54a3-4862-98f6-fe11de597e3c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:47.411125 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4824ffac-54a3-4862-98f6-fe11de597e3c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.281673 Jun 23 22:50:47.411704 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 350/715] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:47 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:47.783712 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-83bb96cf-e4c6-46ed-938c-38763fa297b0 req-fe023a3c-5237-4471-8f43-5a97538d1098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8836b61b-1200-4e32-825c-c6365bded08f", "tag": "b455f4c7-2530-4f19-81ce-74ad3ad051a8"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:47.807027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-83bb96cf-e4c6-46ed-938c-38763fa297b0 req-fe023a3c-5237-4471-8f43-5a97538d1098 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:47.809808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-83bb96cf-e4c6-46ed-938c-38763fa297b0 req-fe023a3c-5237-4471-8f43-5a97538d1098 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:47.833080 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-83bb96cf-e4c6-46ed-938c-38763fa297b0 req-fe023a3c-5237-4471-8f43-5a97538d1098 service nova] Creating event network-changed:b455f4c7-2530-4f19-81ce-74ad3ad051a8 for instance 8836b61b-1200-4e32-825c-c6365bded08f on hv-cinder-81322 Jun 23 22:50:47.838623 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-83bb96cf-e4c6-46ed-938c-38763fa297b0 req-fe023a3c-5237-4471-8f43-5a97538d1098 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058534 Jun 23 22:50:47.841772 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 366/716] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:47.973452 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b7d6ace6-0a8f-4780-9a64-d916ae065134 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:47.974056 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b7d6ace6-0a8f-4780-9a64-d916ae065134 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:47.979989 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b7d6ace6-0a8f-4780-9a64-d916ae065134 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:47.980552 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b7d6ace6-0a8f-4780-9a64-d916ae065134 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:47.981362 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b7d6ace6-0a8f-4780-9a64-d916ae065134 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:47.981796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b7d6ace6-0a8f-4780-9a64-d916ae065134 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:48.114841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b7d6ace6-0a8f-4780-9a64-d916ae065134 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:48.122435 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b7d6ace6-0a8f-4780-9a64-d916ae065134 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.152997 Jun 23 22:50:48.123004 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 351/717] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:47 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:48.146752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-16f6d387-d1a0-4162-af5e-24ec5d59d41a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:48.147450 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-16f6d387-d1a0-4162-af5e-24ec5d59d41a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:48.153913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-16f6d387-d1a0-4162-af5e-24ec5d59d41a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:48.154359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-16f6d387-d1a0-4162-af5e-24ec5d59d41a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:48.155118 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-16f6d387-d1a0-4162-af5e-24ec5d59d41a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:48.155702 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-16f6d387-d1a0-4162-af5e-24ec5d59d41a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:48.414643 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-16f6d387-d1a0-4162-af5e-24ec5d59d41a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:48.422161 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-16f6d387-d1a0-4162-af5e-24ec5d59d41a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.280531 Jun 23 22:50:48.423499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 367/718] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:48 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:48.428221 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-36a433d0-ebc3-4462-8997-543879faebe2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:48.428856 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-36a433d0-ebc3-4462-8997-543879faebe2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:48.435640 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-36a433d0-ebc3-4462-8997-543879faebe2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:48.436088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-36a433d0-ebc3-4462-8997-543879faebe2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:48.436874 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-36a433d0-ebc3-4462-8997-543879faebe2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:48.437309 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-36a433d0-ebc3-4462-8997-543879faebe2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:48.564296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-36a433d0-ebc3-4462-8997-543879faebe2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:48.572408 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-36a433d0-ebc3-4462-8997-543879faebe2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.148603 Jun 23 22:50:48.573045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 352/719] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:48 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:49.139943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cfa5fa2a-6725-4d21-bed2-8dcaa6642bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:49.140485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cfa5fa2a-6725-4d21-bed2-8dcaa6642bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:49.147540 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfa5fa2a-6725-4d21-bed2-8dcaa6642bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:49.147990 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfa5fa2a-6725-4d21-bed2-8dcaa6642bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:49.148785 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfa5fa2a-6725-4d21-bed2-8dcaa6642bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:49.149223 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfa5fa2a-6725-4d21-bed2-8dcaa6642bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:49.356356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cfa5fa2a-6725-4d21-bed2-8dcaa6642bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:49.364906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cfa5fa2a-6725-4d21-bed2-8dcaa6642bcb tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.229165 Jun 23 22:50:49.365476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 368/720] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:49 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:49.440224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-abac6e31-3dec-41e4-979f-2e6498c4a61f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:49.441412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-abac6e31-3dec-41e4-979f-2e6498c4a61f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:49.447785 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-abac6e31-3dec-41e4-979f-2e6498c4a61f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:49.448238 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-abac6e31-3dec-41e4-979f-2e6498c4a61f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:49.449044 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-abac6e31-3dec-41e4-979f-2e6498c4a61f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:49.449483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-abac6e31-3dec-41e4-979f-2e6498c4a61f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:49.580694 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-abac6e31-3dec-41e4-979f-2e6498c4a61f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:49.590708 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-88bd9505-7e12-4326-a6f3-658eeec7e0ca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:49.591453 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-88bd9505-7e12-4326-a6f3-658eeec7e0ca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:49.596426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-abac6e31-3dec-41e4-979f-2e6498c4a61f tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.159889 Jun 23 22:50:49.597263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 353/721] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:49 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:49.599812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-88bd9505-7e12-4326-a6f3-658eeec7e0ca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:49.600276 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-88bd9505-7e12-4326-a6f3-658eeec7e0ca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:49.601199 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-88bd9505-7e12-4326-a6f3-658eeec7e0ca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:49.601632 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-88bd9505-7e12-4326-a6f3-658eeec7e0ca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:49.603415 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-814fbafb-cf81-4b71-9b62-508cbd7463c7 req-008c797b-3920-4749-8fbf-006fe17f1fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc6a308-2725-417e-8596-d39f57306af5", "tag": "407cf8de-21c5-4a4d-8db2-9d64ac13fb20"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:49.611732 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-814fbafb-cf81-4b71-9b62-508cbd7463c7 req-008c797b-3920-4749-8fbf-006fe17f1fba service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:49.612519 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-814fbafb-cf81-4b71-9b62-508cbd7463c7 req-008c797b-3920-4749-8fbf-006fe17f1fba service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:49.624485 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-814fbafb-cf81-4b71-9b62-508cbd7463c7 req-008c797b-3920-4749-8fbf-006fe17f1fba service nova] Creating event network-changed:407cf8de-21c5-4a4d-8db2-9d64ac13fb20 for instance 5dc6a308-2725-417e-8596-d39f57306af5 on hv-cinder-81322 Jun 23 22:50:49.630290 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-814fbafb-cf81-4b71-9b62-508cbd7463c7 req-008c797b-3920-4749-8fbf-006fe17f1fba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030211 Jun 23 22:50:49.631608 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 354/722] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:49.734146 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-88bd9505-7e12-4326-a6f3-658eeec7e0ca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:49.742201 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-88bd9505-7e12-4326-a6f3-658eeec7e0ca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.156302 Jun 23 22:50:49.745914 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 369/723] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:49 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:50.382268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-83b03cbb-df69-476e-aee6-821d63ba8a90 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:50.382882 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-83b03cbb-df69-476e-aee6-821d63ba8a90 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:50.389594 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83b03cbb-df69-476e-aee6-821d63ba8a90 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:50.390042 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83b03cbb-df69-476e-aee6-821d63ba8a90 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:50.390799 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83b03cbb-df69-476e-aee6-821d63ba8a90 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:50.391234 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-83b03cbb-df69-476e-aee6-821d63ba8a90 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:50.519906 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-83b03cbb-df69-476e-aee6-821d63ba8a90 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:50.527416 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-83b03cbb-df69-476e-aee6-821d63ba8a90 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.149579 Jun 23 22:50:50.527974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 355/724] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:50 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:50.618385 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e79c1f70-69fd-4773-9461-5654f03a1c4b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:50.618992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e79c1f70-69fd-4773-9461-5654f03a1c4b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:50.621385 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:50.626129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e79c1f70-69fd-4773-9461-5654f03a1c4b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:50.626572 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e79c1f70-69fd-4773-9461-5654f03a1c4b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:50.627368 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e79c1f70-69fd-4773-9461-5654f03a1c4b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:50.627818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e79c1f70-69fd-4773-9461-5654f03a1c4b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:50.758258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e79c1f70-69fd-4773-9461-5654f03a1c4b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:50.758676 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-55e80973-eb05-46ee-8b85-d94f741a4532 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:50.759292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-55e80973-eb05-46ee-8b85-d94f741a4532 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:50.761309 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:50.766072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55e80973-eb05-46ee-8b85-d94f741a4532 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:50.766255 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e79c1f70-69fd-4773-9461-5654f03a1c4b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.151545 Jun 23 22:50:50.766525 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55e80973-eb05-46ee-8b85-d94f741a4532 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:50.767437 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 370/725] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:50 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:50.767575 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55e80973-eb05-46ee-8b85-d94f741a4532 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:50.767728 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55e80973-eb05-46ee-8b85-d94f741a4532 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:50.898206 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-55e80973-eb05-46ee-8b85-d94f741a4532 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:50.906164 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-55e80973-eb05-46ee-8b85-d94f741a4532 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.151340 Jun 23 22:50:50.906786 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 356/726] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:50 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:51.545132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1bb05dc6-a3c3-4249-ba78-ca383e7bf0f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:51.545649 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1bb05dc6-a3c3-4249-ba78-ca383e7bf0f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:51.552370 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1bb05dc6-a3c3-4249-ba78-ca383e7bf0f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:51.552848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1bb05dc6-a3c3-4249-ba78-ca383e7bf0f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:51.553681 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1bb05dc6-a3c3-4249-ba78-ca383e7bf0f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:51.554108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1bb05dc6-a3c3-4249-ba78-ca383e7bf0f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:51.698491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1bb05dc6-a3c3-4249-ba78-ca383e7bf0f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:51.706985 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1bb05dc6-a3c3-4249-ba78-ca383e7bf0f2 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.165245 Jun 23 22:50:51.707551 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 371/727] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:51 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:51.785725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e5c86419-04b7-4b70-934b-532348e84707 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:51.786420 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e5c86419-04b7-4b70-934b-532348e84707 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:51.794257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5c86419-04b7-4b70-934b-532348e84707 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:51.794796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5c86419-04b7-4b70-934b-532348e84707 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:51.795697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5c86419-04b7-4b70-934b-532348e84707 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:51.796169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5c86419-04b7-4b70-934b-532348e84707 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:51.923477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e66bdf1f-2797-424e-9b2d-d1f4cea51ca2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:51.924559 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e66bdf1f-2797-424e-9b2d-d1f4cea51ca2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:51.931410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e66bdf1f-2797-424e-9b2d-d1f4cea51ca2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:51.931867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e66bdf1f-2797-424e-9b2d-d1f4cea51ca2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:51.932666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e66bdf1f-2797-424e-9b2d-d1f4cea51ca2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:51.933340 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e66bdf1f-2797-424e-9b2d-d1f4cea51ca2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:51.935040 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e5c86419-04b7-4b70-934b-532348e84707 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:51.943577 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e5c86419-04b7-4b70-934b-532348e84707 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.162720 Jun 23 22:50:51.944482 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 357/728] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:51 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:52.085596 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e66bdf1f-2797-424e-9b2d-d1f4cea51ca2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:52.093834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e66bdf1f-2797-424e-9b2d-d1f4cea51ca2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.173935 Jun 23 22:50:52.094401 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 372/729] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:51 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:52.726601 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-52a7d88d-2129-4969-83db-9790290ba767 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:52.727202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-52a7d88d-2129-4969-83db-9790290ba767 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:52.733782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52a7d88d-2129-4969-83db-9790290ba767 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:52.734368 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52a7d88d-2129-4969-83db-9790290ba767 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:52.735463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52a7d88d-2129-4969-83db-9790290ba767 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:52.735891 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-52a7d88d-2129-4969-83db-9790290ba767 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:52.874647 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-52a7d88d-2129-4969-83db-9790290ba767 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:52.882877 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-52a7d88d-2129-4969-83db-9790290ba767 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.160986 Jun 23 22:50:52.883795 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 358/730] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:52 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:52.961569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c3292116-e9af-4a70-81f8-ca9f6c3c65ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:52.962114 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c3292116-e9af-4a70-81f8-ca9f6c3c65ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:52.963896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:52.964556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:52.970113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c3292116-e9af-4a70-81f8-ca9f6c3c65ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:52.970557 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c3292116-e9af-4a70-81f8-ca9f6c3c65ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:52.972516 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c3292116-e9af-4a70-81f8-ca9f6c3c65ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:52.972516 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c3292116-e9af-4a70-81f8-ca9f6c3c65ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:53.110816 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c3292116-e9af-4a70-81f8-ca9f6c3c65ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:53.112751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-24b897a6-1921-4044-a4c0-6ddfa4e8e991 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:53.113609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-24b897a6-1921-4044-a4c0-6ddfa4e8e991 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:53.119862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c3292116-e9af-4a70-81f8-ca9f6c3c65ba tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.162025 Jun 23 22:50:53.120466 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-24b897a6-1921-4044-a4c0-6ddfa4e8e991 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:53.121417 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-24b897a6-1921-4044-a4c0-6ddfa4e8e991 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:53.122234 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-24b897a6-1921-4044-a4c0-6ddfa4e8e991 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:53.122808 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-24b897a6-1921-4044-a4c0-6ddfa4e8e991 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:53.129868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 373/731] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:52 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:53.259653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-24b897a6-1921-4044-a4c0-6ddfa4e8e991 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:53.268338 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-24b897a6-1921-4044-a4c0-6ddfa4e8e991 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.159531 Jun 23 22:50:53.268338 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 359/732] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:53 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:53.900065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c0f6068f-0a9f-44e8-985c-36e08cf00bea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:53.900700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c0f6068f-0a9f-44e8-985c-36e08cf00bea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:53.906971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c0f6068f-0a9f-44e8-985c-36e08cf00bea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:53.907422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c0f6068f-0a9f-44e8-985c-36e08cf00bea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:53.908178 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c0f6068f-0a9f-44e8-985c-36e08cf00bea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:53.908631 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c0f6068f-0a9f-44e8-985c-36e08cf00bea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:54.068865 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c0f6068f-0a9f-44e8-985c-36e08cf00bea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:54.076300 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c0f6068f-0a9f-44e8-985c-36e08cf00bea tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.180148 Jun 23 22:50:54.080379 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 374/733] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:53 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:54.137522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a2e783dc-bba9-4070-b43b-f8fe17c279f9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:54.138337 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a2e783dc-bba9-4070-b43b-f8fe17c279f9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:54.140315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:54.146699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a2e783dc-bba9-4070-b43b-f8fe17c279f9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:54.147191 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a2e783dc-bba9-4070-b43b-f8fe17c279f9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:54.147924 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a2e783dc-bba9-4070-b43b-f8fe17c279f9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:54.148366 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a2e783dc-bba9-4070-b43b-f8fe17c279f9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:54.292131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e1be9b2d-c8b9-46cf-9173-2a1e0c964f4f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:54.292881 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e1be9b2d-c8b9-46cf-9173-2a1e0c964f4f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:54.296629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a2e783dc-bba9-4070-b43b-f8fe17c279f9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:54.300095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e1be9b2d-c8b9-46cf-9173-2a1e0c964f4f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:54.300594 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e1be9b2d-c8b9-46cf-9173-2a1e0c964f4f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:54.301523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e1be9b2d-c8b9-46cf-9173-2a1e0c964f4f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:54.301963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e1be9b2d-c8b9-46cf-9173-2a1e0c964f4f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:54.305985 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a2e783dc-bba9-4070-b43b-f8fe17c279f9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.171783 Jun 23 22:50:54.316659 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 360/734] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:54 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:54.455363 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e1be9b2d-c8b9-46cf-9173-2a1e0c964f4f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:54.463897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e1be9b2d-c8b9-46cf-9173-2a1e0c964f4f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.182864 Jun 23 22:50:54.464487 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 375/735] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:54 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:55.094343 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-41c8eb41-a4ee-4b1c-b9d8-e4f26e3eb3f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:55.094972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-41c8eb41-a4ee-4b1c-b9d8-e4f26e3eb3f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:55.101450 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41c8eb41-a4ee-4b1c-b9d8-e4f26e3eb3f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:55.102059 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41c8eb41-a4ee-4b1c-b9d8-e4f26e3eb3f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:55.103122 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41c8eb41-a4ee-4b1c-b9d8-e4f26e3eb3f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:55.103343 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-41c8eb41-a4ee-4b1c-b9d8-e4f26e3eb3f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:55.250197 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-41c8eb41-a4ee-4b1c-b9d8-e4f26e3eb3f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:55.255737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-41c8eb41-a4ee-4b1c-b9d8-e4f26e3eb3f3 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.165198 Jun 23 22:50:55.256395 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 361/736] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:55 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:55.325325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c29140c5-26a2-4d40-8bf9-409d685c68e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:55.327531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c29140c5-26a2-4d40-8bf9-409d685c68e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:55.335597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c29140c5-26a2-4d40-8bf9-409d685c68e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:55.341966 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c29140c5-26a2-4d40-8bf9-409d685c68e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:55.341966 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c29140c5-26a2-4d40-8bf9-409d685c68e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:55.341966 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c29140c5-26a2-4d40-8bf9-409d685c68e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:55.482825 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c29140c5-26a2-4d40-8bf9-409d685c68e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:55.486835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ee0f055d-96ee-4860-889e-eab5b5935d4c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:55.488202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ee0f055d-96ee-4860-889e-eab5b5935d4c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:55.492080 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c29140c5-26a2-4d40-8bf9-409d685c68e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.171455 Jun 23 22:50:55.493026 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 376/737] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:55 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:55.495417 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ee0f055d-96ee-4860-889e-eab5b5935d4c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:55.495868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ee0f055d-96ee-4860-889e-eab5b5935d4c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:55.496662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ee0f055d-96ee-4860-889e-eab5b5935d4c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:55.497105 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ee0f055d-96ee-4860-889e-eab5b5935d4c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:55.631854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ee0f055d-96ee-4860-889e-eab5b5935d4c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:55.639835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ee0f055d-96ee-4860-889e-eab5b5935d4c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.157717 Jun 23 22:50:55.640738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 362/738] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:55 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:56.015649 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-af96b82f-0f62-4c51-a9e7-940340630803 req-6c3ebe7c-7322-437f-b3fa-e322e79f243a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192d5777-a83f-473b-bc1d-6ae78bd7326c", "name": "network-vif-unplugged", "status": "completed", "tag": "f65b1997-349a-4f3b-8290-efaec03c5e9e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:50:56.025106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-af96b82f-0f62-4c51-a9e7-940340630803 req-6c3ebe7c-7322-437f-b3fa-e322e79f243a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:56.025550 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-af96b82f-0f62-4c51-a9e7-940340630803 req-6c3ebe7c-7322-437f-b3fa-e322e79f243a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:56.037664 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-af96b82f-0f62-4c51-a9e7-940340630803 req-6c3ebe7c-7322-437f-b3fa-e322e79f243a service nova] Creating event network-vif-unplugged:f65b1997-349a-4f3b-8290-efaec03c5e9e for instance 192d5777-a83f-473b-bc1d-6ae78bd7326c on hv-cinder-81322 Jun 23 22:50:56.043007 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-af96b82f-0f62-4c51-a9e7-940340630803 req-6c3ebe7c-7322-437f-b3fa-e322e79f243a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031662 Jun 23 22:50:56.043606 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 377/739] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:50:56.276733 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e3085bf0-331f-453f-8a01-1fac3faa2de6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:56.277352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e3085bf0-331f-453f-8a01-1fac3faa2de6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:56.293794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e3085bf0-331f-453f-8a01-1fac3faa2de6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:56.294497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e3085bf0-331f-453f-8a01-1fac3faa2de6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:56.295449 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e3085bf0-331f-453f-8a01-1fac3faa2de6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:56.296054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e3085bf0-331f-453f-8a01-1fac3faa2de6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:56.444712 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e3085bf0-331f-453f-8a01-1fac3faa2de6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:56.452975 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e3085bf0-331f-453f-8a01-1fac3faa2de6 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.180014 Jun 23 22:50:56.463155 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 363/740] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:56 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:56.510263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d20bc252-1226-498f-aa1a-322ca834bf8a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:56.511108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d20bc252-1226-498f-aa1a-322ca834bf8a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:56.520388 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d20bc252-1226-498f-aa1a-322ca834bf8a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:56.523808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d20bc252-1226-498f-aa1a-322ca834bf8a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:56.523808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d20bc252-1226-498f-aa1a-322ca834bf8a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:56.523808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d20bc252-1226-498f-aa1a-322ca834bf8a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:56.659054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dc171869-1b96-4dba-ba37-f69360d16ed9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:56.659858 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dc171869-1b96-4dba-ba37-f69360d16ed9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:56.666423 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc171869-1b96-4dba-ba37-f69360d16ed9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:56.666983 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc171869-1b96-4dba-ba37-f69360d16ed9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:56.667859 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc171869-1b96-4dba-ba37-f69360d16ed9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:56.668362 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc171869-1b96-4dba-ba37-f69360d16ed9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:56.676376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d20bc252-1226-498f-aa1a-322ca834bf8a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:56.684036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d20bc252-1226-498f-aa1a-322ca834bf8a tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.177923 Jun 23 22:50:56.684848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 378/741] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:56 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:56.822655 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dc171869-1b96-4dba-ba37-f69360d16ed9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:56.831491 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dc171869-1b96-4dba-ba37-f69360d16ed9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.176335 Jun 23 22:50:56.841617 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 364/742] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:56 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:57.472130 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-355d6fc3-059a-401f-9f37-288b41d5d048 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:57.473225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-355d6fc3-059a-401f-9f37-288b41d5d048 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:57.481098 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-355d6fc3-059a-401f-9f37-288b41d5d048 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:57.481564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-355d6fc3-059a-401f-9f37-288b41d5d048 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:57.482358 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-355d6fc3-059a-401f-9f37-288b41d5d048 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:57.482790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-355d6fc3-059a-401f-9f37-288b41d5d048 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:57.628906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-355d6fc3-059a-401f-9f37-288b41d5d048 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:57.636728 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-355d6fc3-059a-401f-9f37-288b41d5d048 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.169669 Jun 23 22:50:57.637314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 379/743] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:57 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:57.701544 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e0a8c392-4406-4911-a2b4-ccf612e2ad9b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:57.702139 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e0a8c392-4406-4911-a2b4-ccf612e2ad9b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:57.709411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0a8c392-4406-4911-a2b4-ccf612e2ad9b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:57.709862 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0a8c392-4406-4911-a2b4-ccf612e2ad9b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:57.710622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0a8c392-4406-4911-a2b4-ccf612e2ad9b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:57.711060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0a8c392-4406-4911-a2b4-ccf612e2ad9b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:57.850598 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ccf07f1f-73e4-4a97-8a76-163bd060c571 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:57.850749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e0a8c392-4406-4911-a2b4-ccf612e2ad9b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:57.851211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ccf07f1f-73e4-4a97-8a76-163bd060c571 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:57.854680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:57.858181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccf07f1f-73e4-4a97-8a76-163bd060c571 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:57.858639 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccf07f1f-73e4-4a97-8a76-163bd060c571 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:57.859427 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccf07f1f-73e4-4a97-8a76-163bd060c571 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:57.859870 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ccf07f1f-73e4-4a97-8a76-163bd060c571 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:57.860253 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e0a8c392-4406-4911-a2b4-ccf612e2ad9b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.162161 Jun 23 22:50:57.867524 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 365/744] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:57 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:58.007014 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ccf07f1f-73e4-4a97-8a76-163bd060c571 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:58.015358 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ccf07f1f-73e4-4a97-8a76-163bd060c571 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.169852 Jun 23 22:50:58.016140 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 380/745] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:57 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:50:58.080344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ae090352-3398-4552-8853-a6dbd131b9df tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:58.081440 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ae090352-3398-4552-8853-a6dbd131b9df tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:58.087937 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae090352-3398-4552-8853-a6dbd131b9df tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:58.088292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae090352-3398-4552-8853-a6dbd131b9df tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:58.089164 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae090352-3398-4552-8853-a6dbd131b9df tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:58.089669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae090352-3398-4552-8853-a6dbd131b9df tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:58.121246 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ae090352-3398-4552-8853-a6dbd131b9df tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/ips" status: 200 len: 151 microversion: 2.20 time: 0.045122 Jun 23 22:50:58.122283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 366/746] 10.222.0.33 () {60 vars in 1288 bytes} [Thu Jun 23 22:50:58 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:50:58.654206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5cd1e7b2-f098-45b0-b288-02745307e17c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:58.654826 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5cd1e7b2-f098-45b0-b288-02745307e17c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:58.662236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5cd1e7b2-f098-45b0-b288-02745307e17c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:58.662688 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5cd1e7b2-f098-45b0-b288-02745307e17c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:58.663451 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5cd1e7b2-f098-45b0-b288-02745307e17c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:58.664137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5cd1e7b2-f098-45b0-b288-02745307e17c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:58.666561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:50:58.802682 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5cd1e7b2-f098-45b0-b288-02745307e17c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:58.810291 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5cd1e7b2-f098-45b0-b288-02745307e17c tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.160066 Jun 23 22:50:58.817928 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 381/747] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:58 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:58.878129 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f90096e6-107d-453f-8e20-573511fd2035 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:58.879751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f90096e6-107d-453f-8e20-573511fd2035 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:58.888060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f90096e6-107d-453f-8e20-573511fd2035 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:58.890258 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f90096e6-107d-453f-8e20-573511fd2035 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:58.890258 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f90096e6-107d-453f-8e20-573511fd2035 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:58.890901 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f90096e6-107d-453f-8e20-573511fd2035 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:59.035811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b7bdef0f-46a1-4992-96fe-2ce853a5606a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:59.037221 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b7bdef0f-46a1-4992-96fe-2ce853a5606a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:59.047235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b7bdef0f-46a1-4992-96fe-2ce853a5606a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:59.048075 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b7bdef0f-46a1-4992-96fe-2ce853a5606a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:59.050258 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b7bdef0f-46a1-4992-96fe-2ce853a5606a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:59.050896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b7bdef0f-46a1-4992-96fe-2ce853a5606a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:59.063402 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f90096e6-107d-453f-8e20-573511fd2035 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:59.084570 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f90096e6-107d-453f-8e20-573511fd2035 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.210074 Jun 23 22:50:59.091143 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 367/748] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:58 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:59.210614 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b7bdef0f-46a1-4992-96fe-2ce853a5606a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:59.218483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b7bdef0f-46a1-4992-96fe-2ce853a5606a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.188651 Jun 23 22:50:59.221846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 382/749] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:59 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:50:59.828836 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-110da271-2836-41ed-8ef6-494002bd032f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:50:59.829436 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-110da271-2836-41ed-8ef6-494002bd032f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:50:59.836341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-110da271-2836-41ed-8ef6-494002bd032f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:59.836819 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-110da271-2836-41ed-8ef6-494002bd032f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:59.837571 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-110da271-2836-41ed-8ef6-494002bd032f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:50:59.838007 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-110da271-2836-41ed-8ef6-494002bd032f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:50:59.963682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-110da271-2836-41ed-8ef6-494002bd032f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:50:59.971671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-110da271-2836-41ed-8ef6-494002bd032f tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1520 microversion: 2.1 time: 0.146739 Jun 23 22:50:59.972434 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 368/750] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:50:59 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:00.107702 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f678c43d-9fc8-4168-bdff-189de486b6e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:00.108455 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f678c43d-9fc8-4168-bdff-189de486b6e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:00.115887 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f678c43d-9fc8-4168-bdff-189de486b6e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:00.116804 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f678c43d-9fc8-4168-bdff-189de486b6e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:00.120861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f678c43d-9fc8-4168-bdff-189de486b6e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:00.120861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f678c43d-9fc8-4168-bdff-189de486b6e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:00.243142 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ef0a3bf6-34ff-4ecb-a6be-e9425116885b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:00.243765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ef0a3bf6-34ff-4ecb-a6be-e9425116885b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:00.250022 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef0a3bf6-34ff-4ecb-a6be-e9425116885b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:00.250612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef0a3bf6-34ff-4ecb-a6be-e9425116885b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:00.251384 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef0a3bf6-34ff-4ecb-a6be-e9425116885b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:00.251990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ef0a3bf6-34ff-4ecb-a6be-e9425116885b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:00.370818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f678c43d-9fc8-4168-bdff-189de486b6e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:00.382929 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f678c43d-9fc8-4168-bdff-189de486b6e6 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.279591 Jun 23 22:51:00.383753 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 383/751] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:00 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:00.770674 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-f1da9672-2dad-47f2-ad71-5bc1875f19e3 req-12f4356d-8529-4cc1-b571-e89c5530dc90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192d5777-a83f-473b-bc1d-6ae78bd7326c", "name": "network-vif-deleted", "tag": "f65b1997-349a-4f3b-8290-efaec03c5e9e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:00.778876 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-f1da9672-2dad-47f2-ad71-5bc1875f19e3 req-12f4356d-8529-4cc1-b571-e89c5530dc90 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:00.779322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-f1da9672-2dad-47f2-ad71-5bc1875f19e3 req-12f4356d-8529-4cc1-b571-e89c5530dc90 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:00.791137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-f1da9672-2dad-47f2-ad71-5bc1875f19e3 req-12f4356d-8529-4cc1-b571-e89c5530dc90 service nova] Creating event network-vif-deleted:f65b1997-349a-4f3b-8290-efaec03c5e9e for instance 192d5777-a83f-473b-bc1d-6ae78bd7326c on hv-cinder-81322 Jun 23 22:51:00.796199 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-f1da9672-2dad-47f2-ad71-5bc1875f19e3 req-12f4356d-8529-4cc1-b571-e89c5530dc90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089272 Jun 23 22:51:00.796839 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 384/752] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:00.892051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ef0a3bf6-34ff-4ecb-a6be-e9425116885b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:00.900489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ef0a3bf6-34ff-4ecb-a6be-e9425116885b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.662813 Jun 23 22:51:00.901115 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 369/753] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:00 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:00.990439 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:00.991396 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:00.999914 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.000367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:01.001174 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.001605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:01.047494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.048230 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:01.048924 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lazy-loading 'fault' on Instance uuid 192d5777-a83f-473b-bc1d-6ae78bd7326c {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:51:01.100291 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '675d117397da452faa5221af0906fb12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ed20d55acb41fcb18006919476bf80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:01.108436 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f20e177a-fe41-4b3d-9cc2-6502c0751c4e tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 200 len: 1311 microversion: 2.1 time: 0.123339 Jun 23 22:51:01.109423 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 385/754] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:00 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:01.400451 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5c06b565-6f7b-4f64-918b-f3d725e91452 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:01.401144 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c06b565-6f7b-4f64-918b-f3d725e91452 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:01.407314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c06b565-6f7b-4f64-918b-f3d725e91452 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.407775 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c06b565-6f7b-4f64-918b-f3d725e91452 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:01.409534 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c06b565-6f7b-4f64-918b-f3d725e91452 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.409996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c06b565-6f7b-4f64-918b-f3d725e91452 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:01.447741 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-52287602-d5cd-4aa7-b020-b412b4d32fea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:01.455528 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-52287602-d5cd-4aa7-b020-b412b4d32fea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:01.455528 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-52287602-d5cd-4aa7-b020-b412b4d32fea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.455528 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-52287602-d5cd-4aa7-b020-b412b4d32fea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:01.456882 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-52287602-d5cd-4aa7-b020-b412b4d32fea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.457332 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-52287602-d5cd-4aa7-b020-b412b4d32fea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:01.482125 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-52287602-d5cd-4aa7-b020-b412b4d32fea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lazy-loading 'flavor' on Instance uuid b650e20d-eaa7-4c0c-a6c1-972b92705862 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:51:01.741436 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5c06b565-6f7b-4f64-918b-f3d725e91452 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:01.751355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5c06b565-6f7b-4f64-918b-f3d725e91452 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1681 microversion: 2.1 time: 0.354667 Jun 23 22:51:01.752669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 370/755] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:01 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1681 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:01.917412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e5c66d52-6569-4860-b589-8f39d7fc2d4e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:01.918021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e5c66d52-6569-4860-b589-8f39d7fc2d4e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:01.924753 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5c66d52-6569-4860-b589-8f39d7fc2d4e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.925207 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5c66d52-6569-4860-b589-8f39d7fc2d4e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:01.925968 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5c66d52-6569-4860-b589-8f39d7fc2d4e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:01.926398 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e5c66d52-6569-4860-b589-8f39d7fc2d4e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:02.052447 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-52287602-d5cd-4aa7-b020-b412b4d32fea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/action" status: 202 len: 0 microversion: 2.20 time: 0.608473 Jun 23 22:51:02.053276 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 386/756] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 23 22:51:01 2022] POST /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:51:02.067684 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:02.068388 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:02.079717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:02.088043 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:02.088043 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:02.088043 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:02.232545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e5c66d52-6569-4860-b589-8f39d7fc2d4e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:02.246984 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e5c66d52-6569-4860-b589-8f39d7fc2d4e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.333219 Jun 23 22:51:02.247393 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:02.249945 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 371/757] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:01 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:02.255576 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:02.256196 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] [instance: 192d5777-a83f-473b-bc1d-6ae78bd7326c] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:02.257567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:02.259886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:02.261156 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ec6057c6-3133-4151-90b6-eb061a8db7b3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.203585 Jun 23 22:51:02.264855 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 387/758] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:02 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:02.269455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:02.270051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:02.270910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:02.271527 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:02.294278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] HTTP exception thrown: Instance 192d5777-a83f-473b-bc1d-6ae78bd7326c could not be found. Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Request method failure captured: Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c HTTP/1.1 Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0Fxgf8_W6nHzji-QVv9jKiLp4rg6lH_y6-T4g881cdcaBRhykJO0GrB4dCqu9pFmtp2fywc254ujM1yS_W8gisUumxZqIVtBkou9tpTQgKGhiSBP4vuty0nKCS6oCe-_37EzZxMUls-mnqqoz3G_53dfhEX2AvYPxQ_-nmCoCt624 Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:51:02.296089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_19ed20d55acb41fcb18006919476bf80", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/19ed20d55acb41fcb18006919476bf80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 19ed20d55acb41fcb18006919476bf80 Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-57761231 Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 675d117397da452faa5221af0906fb12 Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-ServerRescueNegativeTestJSON-57761231-project Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 192d5777-a83f-473b-bc1d-6ae78bd7326c could not be found. Jun 23 22:51:02.297835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '192d5777-a83f-473b-bc1d-6ae78bd7326c'} Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 192d5777-a83f-473b-bc1d-6ae78bd7326c could not be found. Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:51:02.298979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 192d5777-a83f-473b-bc1d-6ae78bd7326c could not be found. Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 192d5777-a83f-473b-bc1d-6ae78bd7326c could not be found. Jun 23 22:51:02.300522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:02.301847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] Returning 404 to user: Instance 192d5777-a83f-473b-bc1d-6ae78bd7326c could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:51:02.301847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2e039069-64c4-4e65-acd7-b5859a0dc975 tempest-ServerRescueNegativeTestJSON-57761231 tempest-ServerRescueNegativeTestJSON-57761231-project] 10.222.0.33 "GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c" status: 404 len: 111 microversion: 2.1 time: 0.049707 Jun 23 22:51:02.303124 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 372/759] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:02 2022] GET /compute/v2.1/servers/192d5777-a83f-473b-bc1d-6ae78bd7326c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:51:02.381646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-1fa4dccc-d61f-4a57-88fa-199ee02309a7 req-a3f0b7cc-7d70-4565-a18a-1e6becc30dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49d70e57-0b2f-40c0-92c9-ff20698a0de0", "name": "network-vif-deleted", "tag": "b4c10430-af66-4bfe-a53d-76bd44b045e3"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:02.389873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-1fa4dccc-d61f-4a57-88fa-199ee02309a7 req-a3f0b7cc-7d70-4565-a18a-1e6becc30dee service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:02.390312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-1fa4dccc-d61f-4a57-88fa-199ee02309a7 req-a3f0b7cc-7d70-4565-a18a-1e6becc30dee service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:02.402728 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-1fa4dccc-d61f-4a57-88fa-199ee02309a7 req-a3f0b7cc-7d70-4565-a18a-1e6becc30dee service nova] Creating event network-vif-deleted:b4c10430-af66-4bfe-a53d-76bd44b045e3 for instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 on hv-cinder-81322 Jun 23 22:51:02.407662 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-1fa4dccc-d61f-4a57-88fa-199ee02309a7 req-a3f0b7cc-7d70-4565-a18a-1e6becc30dee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087546 Jun 23 22:51:02.408728 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 388/760] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:02.773520 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-77ac0908-a6bf-4106-bf35-726020cf42ff tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:02.774199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-77ac0908-a6bf-4106-bf35-726020cf42ff tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:02.780064 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77ac0908-a6bf-4106-bf35-726020cf42ff tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:02.780509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77ac0908-a6bf-4106-bf35-726020cf42ff tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:02.781309 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77ac0908-a6bf-4106-bf35-726020cf42ff tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:02.781907 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77ac0908-a6bf-4106-bf35-726020cf42ff tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:02.845966 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-77ac0908-a6bf-4106-bf35-726020cf42ff tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:02.854523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-77ac0908-a6bf-4106-bf35-726020cf42ff tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1613 microversion: 2.1 time: 0.084672 Jun 23 22:51:02.855404 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 373/761] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:02 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1613 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:03.265391 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3db9744f-bc21-4e2f-a3e3-509dddff20cc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:03.267116 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3db9744f-bc21-4e2f-a3e3-509dddff20cc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:03.280875 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:03.281572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:03.294227 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3db9744f-bc21-4e2f-a3e3-509dddff20cc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:03.296242 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:03.296961 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:03.299693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:03.299693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:03.300232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3db9744f-bc21-4e2f-a3e3-509dddff20cc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:03.301268 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3db9744f-bc21-4e2f-a3e3-509dddff20cc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:03.301870 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3db9744f-bc21-4e2f-a3e3-509dddff20cc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:03.456824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:03.464887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:03.466372 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:03.467522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-23dda08d-6c3a-4048-9bac-1a5c3addf4e8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.190624 Jun 23 22:51:03.468068 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 374/762] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:03 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:03.546925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3db9744f-bc21-4e2f-a3e3-509dddff20cc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:03.555086 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3db9744f-bc21-4e2f-a3e3-509dddff20cc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.295300 Jun 23 22:51:03.556336 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 389/763] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:03 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:03.881806 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:03.882486 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:03.889537 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:03.890065 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:03.890934 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:03.891421 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:03.923310 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:03.923759 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:03.924279 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lazy-loading 'fault' on Instance uuid 49d70e57-0b2f-40c0-92c9-ff20698a0de0 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:51:03.965605 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:03.973295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-14ab44f0-d123-4efb-823e-bd0c65bbeff7 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 200 len: 1332 microversion: 2.1 time: 0.098567 Jun 23 22:51:03.973864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 375/764] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:03 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:04.489317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:04.490965 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:04.497813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:04.498376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:04.499224 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:04.499740 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:04.572012 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2fc28439-3906-4847-a1df-fabdd978256d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:04.572543 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2fc28439-3906-4847-a1df-fabdd978256d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:04.580867 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fc28439-3906-4847-a1df-fabdd978256d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:04.581606 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fc28439-3906-4847-a1df-fabdd978256d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:04.582376 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fc28439-3906-4847-a1df-fabdd978256d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:04.582905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2fc28439-3906-4847-a1df-fabdd978256d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:04.720040 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2fc28439-3906-4847-a1df-fabdd978256d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:04.727874 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2fc28439-3906-4847-a1df-fabdd978256d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.159870 Jun 23 22:51:04.728556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 376/765] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:04 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:51:04.731865 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:04.740288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:04.741906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:04.743158 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e9ae2591-0069-4b8d-94a8-5275258e572b tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.259462 Jun 23 22:51:04.748618 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 390/766] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:04 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:04.991126 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:04.992324 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:04.998517 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:04.998959 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:04.999714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:05.000141 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:05.015072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 HTTP/1.1 Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:51:05.016658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:51:05.018345 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '49d70e57-0b2f-40c0-92c9-ff20698a0de0'} Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:51:05.019749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:51:05.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:51:05.023112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:51:05.023112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-23827a68-33ed-4358-b553-0a888561e00b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 404 len: 111 microversion: 2.1 time: 0.031377 Jun 23 22:51:05.023112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 377/767] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:04 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:51:05.027227 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0d4bf54f-2a07-4cb5-a3f8-e7dce0072660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '.version_select at 0x7fbbca3d3700>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:05.131103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0d4bf54f-2a07-4cb5-a3f8-e7dce0072660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753477397" status: 202 len: 0 microversion: 2.1 time: 0.107882 Jun 23 22:51:05.131687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 391/768] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 23 22:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1753477397 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:51:05.745513 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d608b9b2-102c-43dd-90fe-02b6841366c6 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:05.746528 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d608b9b2-102c-43dd-90fe-02b6841366c6 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:05.753903 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d608b9b2-102c-43dd-90fe-02b6841366c6 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:05.754710 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d608b9b2-102c-43dd-90fe-02b6841366c6 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:05.755719 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d608b9b2-102c-43dd-90fe-02b6841366c6 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:05.756380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d608b9b2-102c-43dd-90fe-02b6841366c6 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:05.762317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:05.762938 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:05.775675 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:05.776128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:05.777961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:05.781111 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:05.951315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:05.964251 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:05.966213 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:05.967664 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-86702e56-3696-42ff-9044-1fb589b27397 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.210264 Jun 23 22:51:05.972599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 392/769] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:05 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:06.184248 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d608b9b2-102c-43dd-90fe-02b6841366c6 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:06.193059 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d608b9b2-102c-43dd-90fe-02b6841366c6 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.451299 Jun 23 22:51:06.193646 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 378/770] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:05 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:06.332103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ca09a82c-b2be-4f4c-abee-9a33c755e9e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: .version_select at 0x7fbbca3fc5e0>, body: {"keypair": {"name": "tempest-keypair-2031554355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgRG3Xx2bXywJdhwGyoDF8WqkOWQejr0htFCHgT6qoEPOEZoGVZTG5YPD1EPfYRfjXBjh9Sn83W2rFtPOFNKBIi1WPVgeJgZpgnW7tpm4Kss8wK2c5H4YvMQnMT6b2Row=="}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:06.352745 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-ca09a82c-b2be-4f4c-abee-9a33c755e9e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:51:06.362665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-ca09a82c-b2be-4f4c-abee-9a33c755e9e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for user 1d7e431402f8433fb7565f69103485ce and project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:51:06.467014 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ca09a82c-b2be-4f4c-abee-9a33c755e9e1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.138960 Jun 23 22:51:06.467614 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 393/771] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:51:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:06.990756 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:06.992250 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:06.999598 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:07.000160 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:07.001074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:07.001898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:07.197198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:07.206718 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:07.208338 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:07.209610 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2c545316-8171-4cf0-a6ec-9ce950da88d2 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.223867 Jun 23 22:51:07.210238 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 379/772] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:06 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:07.211171 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7569c2af-c76e-4780-88dc-2d60ec690cba tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:07.211782 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7569c2af-c76e-4780-88dc-2d60ec690cba tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:07.218340 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7569c2af-c76e-4780-88dc-2d60ec690cba tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:07.218782 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7569c2af-c76e-4780-88dc-2d60ec690cba tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:07.219543 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7569c2af-c76e-4780-88dc-2d60ec690cba tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:07.219974 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7569c2af-c76e-4780-88dc-2d60ec690cba tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:07.360698 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7569c2af-c76e-4780-88dc-2d60ec690cba tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:07.368454 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7569c2af-c76e-4780-88dc-2d60ec690cba tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.162151 Jun 23 22:51:07.369037 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 394/773] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:07 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:51:08.227729 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:08.228627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:08.238520 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:08.239721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:08.240970 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:08.241818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:08.412049 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-eaedca84-d5f9-4f21-9ef3-3a171a9058b1 req-eb46091f-1068-42e6-89a4-42cddb45ddeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8836b61b-1200-4e32-825c-c6365bded08f", "name": "network-vif-plugged", "status": "completed", "tag": "b455f4c7-2530-4f19-81ce-74ad3ad051a8"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:08.420164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-eaedca84-d5f9-4f21-9ef3-3a171a9058b1 req-eb46091f-1068-42e6-89a4-42cddb45ddeb service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:08.420751 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-eaedca84-d5f9-4f21-9ef3-3a171a9058b1 req-eb46091f-1068-42e6-89a4-42cddb45ddeb service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:08.431746 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-eaedca84-d5f9-4f21-9ef3-3a171a9058b1 req-eb46091f-1068-42e6-89a4-42cddb45ddeb service nova] Creating event network-vif-plugged:b455f4c7-2530-4f19-81ce-74ad3ad051a8 for instance 8836b61b-1200-4e32-825c-c6365bded08f on hv-cinder-81322 Jun 23 22:51:08.436629 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-eaedca84-d5f9-4f21-9ef3-3a171a9058b1 req-eb46091f-1068-42e6-89a4-42cddb45ddeb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206349 Jun 23 22:51:08.437238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 395/774] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:51:08.443476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0837eeb0-1c4d-4800-907e-1be3bd80c643 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:08.444180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0837eeb0-1c4d-4800-907e-1be3bd80c643 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:08.450732 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0837eeb0-1c4d-4800-907e-1be3bd80c643 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:08.451192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0837eeb0-1c4d-4800-907e-1be3bd80c643 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:08.451970 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0837eeb0-1c4d-4800-907e-1be3bd80c643 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:08.452414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0837eeb0-1c4d-4800-907e-1be3bd80c643 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:08.453863 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:08.463446 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:08.465220 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:08.466577 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-22a0be5c-905b-42f9-8184-6a92be30a103 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.242868 Jun 23 22:51:08.478329 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 380/775] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:08 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:08.605445 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0837eeb0-1c4d-4800-907e-1be3bd80c643 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:08.614346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0837eeb0-1c4d-4800-907e-1be3bd80c643 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.175877 Jun 23 22:51:08.614926 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 396/776] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:08 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:09.004832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-343693561", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c28b5ed-da0d-4ee9-8621-fe10ec1946bf"}], "security_groups": [{"name": "tempest-securitygroup--1818367154"}], "key_name": "tempest-keypair-2031554355", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:09.105518 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] validate_networks() for [('3c28b5ed-da0d-4ee9-8621-fe10ec1946bf', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:51:09.487120 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:09.487832 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:09.494604 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:09.495131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:09.496406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:09.497039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:09.534609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:51:09.535100 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:51:09.535500 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:51:09.535913 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:51:09.536316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:51:09.545966 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:09.547543 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:09.547852 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:09.548302 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:09.567650 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:51:09.572121 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Getting quotas for user 1d7e431402f8433fb7565f69103485ce and project 18ed82f19aa2407dac94c2dc67a3fa9c. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:51:09.587585 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:51:09.590121 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:51:09.655301 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:09.669527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:09.671035 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:09.672209 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cb03f67d-4e8e-4e98-bd6c-c1fa1ba06ed3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.190421 Jun 23 22:51:09.672792 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 397/777] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:09 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:09.678103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-47d30d75-5173-444a-9628-4ba62e8bc00a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:09.678724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-47d30d75-5173-444a-9628-4ba62e8bc00a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:09.685807 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47d30d75-5173-444a-9628-4ba62e8bc00a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:09.685807 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47d30d75-5173-444a-9628-4ba62e8bc00a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:09.686221 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47d30d75-5173-444a-9628-4ba62e8bc00a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:09.686659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-47d30d75-5173-444a-9628-4ba62e8bc00a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:09.771685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e2217461-088d-4e71-9bf1-4bdbf67cc54d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.771362 Jun 23 22:51:09.776058 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 381/778] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:51:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:51:09.782302 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c84bfef8-cbae-412e-b6b6-c8d4ed757081 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:09.783945 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c84bfef8-cbae-412e-b6b6-c8d4ed757081 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:09.835793 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-47d30d75-5173-444a-9628-4ba62e8bc00a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:09.843404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-47d30d75-5173-444a-9628-4ba62e8bc00a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1359 microversion: 2.1 time: 0.169573 Jun 23 22:51:09.843981 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 398/779] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:09 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:09.874350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c84bfef8-cbae-412e-b6b6-c8d4ed757081 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:09.883429 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c84bfef8-cbae-412e-b6b6-c8d4ed757081 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1241 microversion: 2.1 time: 0.104948 Jun 23 22:51:09.884318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 382/780] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:09 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:51:10.693277 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:10.694135 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:10.715025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:10.715509 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:10.716667 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:10.717317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:10.742688 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:10.861352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-29b3c861-e5eb-4d7a-b2d6-b1669e87ba69 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:10.862163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-29b3c861-e5eb-4d7a-b2d6-b1669e87ba69 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:10.868701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b3c861-e5eb-4d7a-b2d6-b1669e87ba69 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:10.869222 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b3c861-e5eb-4d7a-b2d6-b1669e87ba69 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:10.870036 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b3c861-e5eb-4d7a-b2d6-b1669e87ba69 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:10.870532 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29b3c861-e5eb-4d7a-b2d6-b1669e87ba69 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:10.936819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:10.946652 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:10.948203 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:10.949375 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-010655b3-c3fc-4499-a59b-0e9c418f2fbd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.260402 Jun 23 22:51:10.953553 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 399/781] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:10 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:10.978232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1cd0b87d-f950-4f4f-a88f-d67e0958ac58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:10.979131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1cd0b87d-f950-4f4f-a88f-d67e0958ac58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:10.994325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1cd0b87d-f950-4f4f-a88f-d67e0958ac58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:10.994787 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1cd0b87d-f950-4f4f-a88f-d67e0958ac58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:10.995830 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1cd0b87d-f950-4f4f-a88f-d67e0958ac58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:10.996234 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1cd0b87d-f950-4f4f-a88f-d67e0958ac58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:11.044016 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-29b3c861-e5eb-4d7a-b2d6-b1669e87ba69 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:11.054986 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-29b3c861-e5eb-4d7a-b2d6-b1669e87ba69 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1549 microversion: 2.1 time: 0.197621 Jun 23 22:51:11.056672 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 383/782] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:10 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1549 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:51:11.074440 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dc0ce3fd-7d0d-4aaa-9eb1-cb93fba5c004 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:11.075563 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dc0ce3fd-7d0d-4aaa-9eb1-cb93fba5c004 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:11.084119 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc0ce3fd-7d0d-4aaa-9eb1-cb93fba5c004 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:11.084963 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc0ce3fd-7d0d-4aaa-9eb1-cb93fba5c004 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:11.085908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc0ce3fd-7d0d-4aaa-9eb1-cb93fba5c004 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:11.086612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dc0ce3fd-7d0d-4aaa-9eb1-cb93fba5c004 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:11.241776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dc0ce3fd-7d0d-4aaa-9eb1-cb93fba5c004 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:11.264184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dc0ce3fd-7d0d-4aaa-9eb1-cb93fba5c004 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1549 microversion: 2.1 time: 0.194129 Jun 23 22:51:11.276505 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 384/783] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:11 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1549 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:51:11.292341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:11.297129 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:11.297982 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Searching by: {'deleted': False, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa'} {{(pid=124725) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 22:51:11.306054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:11.306505 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:11.307366 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:11.307859 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:11.369958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1cd0b87d-f950-4f4f-a88f-d67e0958ac58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:11.381096 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1cd0b87d-f950-4f4f-a88f-d67e0958ac58 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1237 microversion: 2.1 time: 0.423811 Jun 23 22:51:11.382182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 400/784] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:10 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1237 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:11.399876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.multi_cell_list [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124725) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 22:51:11.427192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:11.523144 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7ecd2ab0-579d-4da7-8c30-78f27ed3231d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.241127 Jun 23 22:51:11.524301 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 385/785] 10.222.0.33 () {58 vars in 1124 bytes} [Thu Jun 23 22:51:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:11.535166 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3f5d6c36-fc9f-427b-976b-32ba77558ebd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:11.535973 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3f5d6c36-fc9f-427b-976b-32ba77558ebd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:11.548006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f5d6c36-fc9f-427b-976b-32ba77558ebd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:11.548610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f5d6c36-fc9f-427b-976b-32ba77558ebd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:11.549607 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f5d6c36-fc9f-427b-976b-32ba77558ebd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:11.550117 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3f5d6c36-fc9f-427b-976b-32ba77558ebd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:11.755534 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3f5d6c36-fc9f-427b-976b-32ba77558ebd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:11.763048 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3f5d6c36-fc9f-427b-976b-32ba77558ebd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1549 microversion: 2.1 time: 0.232622 Jun 23 22:51:11.763603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 401/786] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:11 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:11.972473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:11.975929 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:11.990072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:11.992973 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:11.994101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:11.994765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:12.402758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b2759141-42f8-4edb-a4ed-65088d7b193e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:12.404301 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b2759141-42f8-4edb-a4ed-65088d7b193e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:12.414063 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2759141-42f8-4edb-a4ed-65088d7b193e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:12.414906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2759141-42f8-4edb-a4ed-65088d7b193e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:12.415913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2759141-42f8-4edb-a4ed-65088d7b193e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:12.416645 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:12.417240 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2759141-42f8-4edb-a4ed-65088d7b193e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:12.430898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:12.436698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:12.436698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-14041590-a7bc-4684-a14c-8c92da436ba1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.466717 Jun 23 22:51:12.445952 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 386/787] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:11 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:12.526899 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b2759141-42f8-4edb-a4ed-65088d7b193e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:12.536127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b2759141-42f8-4edb-a4ed-65088d7b193e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1299 microversion: 2.1 time: 0.140454 Jun 23 22:51:12.546225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 402/788] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:12 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:13.452400 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:13.453089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:13.460896 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:13.461561 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:13.462490 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:13.462912 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:13.558504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-008b9239-7879-4c2f-a558-a28c3c4c3e11 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:13.559303 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-008b9239-7879-4c2f-a558-a28c3c4c3e11 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:13.567049 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-008b9239-7879-4c2f-a558-a28c3c4c3e11 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:13.567766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-008b9239-7879-4c2f-a558-a28c3c4c3e11 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:13.568784 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-008b9239-7879-4c2f-a558-a28c3c4c3e11 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:13.569494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-008b9239-7879-4c2f-a558-a28c3c4c3e11 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:13.768849 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-008b9239-7879-4c2f-a558-a28c3c4c3e11 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:13.776533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-008b9239-7879-4c2f-a558-a28c3c4c3e11 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.221853 Jun 23 22:51:13.777346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 403/789] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:13 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:51:13.866143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ba0b2354-81d0-48b2-b039-fe4aa6e7671d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "081b76c0-1201-43cc-bae1-6235219ea22a"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:13.867609 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ba0b2354-81d0-48b2-b039-fe4aa6e7671d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:13.874017 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba0b2354-81d0-48b2-b039-fe4aa6e7671d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:13.874546 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba0b2354-81d0-48b2-b039-fe4aa6e7671d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:13.875528 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba0b2354-81d0-48b2-b039-fe4aa6e7671d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:13.876120 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ba0b2354-81d0-48b2-b039-fe4aa6e7671d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:14.007747 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:14.016602 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:14.018792 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:14.019956 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-98c073de-6b36-4eff-a023-ecc357218369 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.571490 Jun 23 22:51:14.020496 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 387/790] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:13 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:14.586297 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-715eee49-6873-4ecd-8114-e45b944ea306 req-ae65e2f9-3519-4f44-ac51-c486307152ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4088ae49-8ab6-4972-aab8-b031ca199296", "tag": "877ad78a-539d-46ac-b4ef-390cdb390092"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:14.605278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-715eee49-6873-4ecd-8114-e45b944ea306 req-ae65e2f9-3519-4f44-ac51-c486307152ee service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:14.605278 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-715eee49-6873-4ecd-8114-e45b944ea306 req-ae65e2f9-3519-4f44-ac51-c486307152ee service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:14.627611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-715eee49-6873-4ecd-8114-e45b944ea306 req-ae65e2f9-3519-4f44-ac51-c486307152ee service nova] Creating event network-changed:877ad78a-539d-46ac-b4ef-390cdb390092 for instance 4088ae49-8ab6-4972-aab8-b031ca199296 on hv-cinder-81322 Jun 23 22:51:14.634145 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-715eee49-6873-4ecd-8114-e45b944ea306 req-ae65e2f9-3519-4f44-ac51-c486307152ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052594 Jun 23 22:51:14.638439 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 388/791] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:14.666446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ba0b2354-81d0-48b2-b039-fe4aa6e7671d tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "POST /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805176 Jun 23 22:51:14.667179 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 404/792] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:51:13 2022] POST /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments => generated 194 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:14.795519 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5b6b53a0-f03b-4f6e-be65-565f50841088 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:14.796519 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5b6b53a0-f03b-4f6e-be65-565f50841088 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:14.813688 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b6b53a0-f03b-4f6e-be65-565f50841088 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:14.818135 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b6b53a0-f03b-4f6e-be65-565f50841088 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:14.818135 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b6b53a0-f03b-4f6e-be65-565f50841088 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:14.818135 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b6b53a0-f03b-4f6e-be65-565f50841088 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:15.041867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:15.042754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:15.052018 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:15.052545 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:15.053513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:15.054016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:15.224997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:15.227713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5b6b53a0-f03b-4f6e-be65-565f50841088 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:15.234834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:15.237098 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5b6b53a0-f03b-4f6e-be65-565f50841088 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.446172 Jun 23 22:51:15.237238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:15.237681 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 389/793] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:14 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:15.238898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cccfc276-1df0-4dba-a2d6-6905be0e5f0a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.204007 Jun 23 22:51:15.250167 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 405/794] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:15 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:16.257902 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:16.258691 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f3624e10-6161-4e3b-a24b-1f448ea9454c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:16.259321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f3624e10-6161-4e3b-a24b-1f448ea9454c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:16.264693 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:16.266267 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3624e10-6161-4e3b-a24b-1f448ea9454c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:16.266727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3624e10-6161-4e3b-a24b-1f448ea9454c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:16.267626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3624e10-6161-4e3b-a24b-1f448ea9454c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:16.268483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f3624e10-6161-4e3b-a24b-1f448ea9454c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:16.274847 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:16.275538 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:16.276504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:16.277343 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:16.379622 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=4 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:16.440723 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f3624e10-6161-4e3b-a24b-1f448ea9454c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:16.451503 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f3624e10-6161-4e3b-a24b-1f448ea9454c tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.199925 Jun 23 22:51:16.452691 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 390/795] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:16 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:16.480774 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:16.490862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:16.492645 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:16.493923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-859d0738-f144-4f26-9094-d9968d960f09 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.239830 Jun 23 22:51:16.504490 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 406/796] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:16 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:16.585950 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-58c9c00d-b678-4749-b37a-4f1c69fa6ad0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'create', calling method: .version_select at 0x7fbbca1f5f70>, body: {"keypair": {"name": "tempest-keypair-700888045", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbbzy40tYrehp6DswIfK4wjARr5QTsnyMSm/wKA2gtknSwDFAgr2ouJ6dk61DF2aTSOOFRdlzov1AUx2kGJUFEz1Psg9wiR4zQMyRUwP3iZiPqCeqHu96OLnl3v76LwrQ=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:16.600977 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-58c9c00d-b678-4749-b37a-4f1c69fa6ad0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Getting quotas for project 73d61a582ec24f99aaf018e55f1f049b. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:51:16.604773 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-58c9c00d-b678-4749-b37a-4f1c69fa6ad0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Getting quotas for user 92ce6158277146228cb13194e9d7b04b and project 73d61a582ec24f99aaf018e55f1f049b. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:51:16.621082 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:16.702235 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-58c9c00d-b678-4749-b37a-4f1c69fa6ad0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238343 Jun 23 22:51:16.703021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 391/797] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:51:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:51:17.469567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e4e01e82-07a5-44cb-9168-7521943c4a46 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:17.470736 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e4e01e82-07a5-44cb-9168-7521943c4a46 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:17.478182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4e01e82-07a5-44cb-9168-7521943c4a46 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:17.478599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4e01e82-07a5-44cb-9168-7521943c4a46 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:17.479380 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4e01e82-07a5-44cb-9168-7521943c4a46 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:17.479812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4e01e82-07a5-44cb-9168-7521943c4a46 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:17.511940 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:17.512731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:17.528671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:17.529502 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:17.533581 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:17.536365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:17.707547 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e4e01e82-07a5-44cb-9168-7521943c4a46 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:17.716820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e4e01e82-07a5-44cb-9168-7521943c4a46 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.251251 Jun 23 22:51:17.727325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 407/798] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:17 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:17.753830 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:17.764642 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:17.766295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:17.768247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-40387c57-f20b-4f59-94f4-3bf109f21a3f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.260857 Jun 23 22:51:17.769477 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 392/799] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:17 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:18.737658 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3e3f41a4-5761-44ca-ad3d-6c8c923da660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:18.738288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3e3f41a4-5761-44ca-ad3d-6c8c923da660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:18.747514 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e3f41a4-5761-44ca-ad3d-6c8c923da660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:18.747975 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e3f41a4-5761-44ca-ad3d-6c8c923da660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:18.748848 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e3f41a4-5761-44ca-ad3d-6c8c923da660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:18.749785 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3e3f41a4-5761-44ca-ad3d-6c8c923da660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:18.787257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:18.789112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:18.802282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:18.802936 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:18.803824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:18.804402 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:18.964228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:18.974553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:18.978959 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:18.980434 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ea257ddf-4fb1-4de1-9653-6cfe24eb3750 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.197820 Jun 23 22:51:18.992566 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 393/800] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:18 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:19.013978 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3e3f41a4-5761-44ca-ad3d-6c8c923da660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:19.025072 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3e3f41a4-5761-44ca-ad3d-6c8c923da660 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.294964 Jun 23 22:51:19.025970 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 408/801] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:18 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:19.162712 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1486340017", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b290ecdc-1395-4ffa-9481-d98d01d37dc3"}], "security_groups": [{"name": "tempest-securitygroup--1776378991"}], "key_name": "tempest-keypair-700888045", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:19.268870 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] validate_networks() for [('b290ecdc-1395-4ffa-9481-d98d01d37dc3', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:51:19.845929 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:51:19.846510 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:51:19.846797 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:51:19.847197 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:51:19.847605 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:51:19.856333 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:19.856813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:19.857604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:19.858035 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:19.874823 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Getting quotas for project 73d61a582ec24f99aaf018e55f1f049b. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:51:19.879533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Getting quotas for user 92ce6158277146228cb13194e9d7b04b and project 73d61a582ec24f99aaf018e55f1f049b. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:51:19.890178 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:51:19.892497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:51:19.999632 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:20.000290 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:20.007879 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:20.008260 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:20.009061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:20.009537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:20.029688 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c23e56d9-39ad-4104-8fbb-2345370a2696 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.874660 Jun 23 22:51:20.030911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 394/802] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:51:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:51:20.043888 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-86febf25-ac9e-44e0-8cee-76d7ce326fde tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:20.050867 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86febf25-ac9e-44e0-8cee-76d7ce326fde tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:20.119208 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-86febf25-ac9e-44e0-8cee-76d7ce326fde tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:20.131236 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-86febf25-ac9e-44e0-8cee-76d7ce326fde tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1237 microversion: 2.1 time: 0.092589 Jun 23 22:51:20.131982 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 395/803] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:20 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:20.137263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-65b6fb92-9e85-4d2d-9cc9-458a733fdbd0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:20.138112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-65b6fb92-9e85-4d2d-9cc9-458a733fdbd0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:20.144965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65b6fb92-9e85-4d2d-9cc9-458a733fdbd0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:20.145475 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65b6fb92-9e85-4d2d-9cc9-458a733fdbd0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:20.146246 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65b6fb92-9e85-4d2d-9cc9-458a733fdbd0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:20.146989 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65b6fb92-9e85-4d2d-9cc9-458a733fdbd0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:20.203523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:20.212545 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:20.214073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:20.215230 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-bbfee6b9-63c3-44da-957e-401bd5f59490 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.219513 Jun 23 22:51:20.216113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 409/804] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:19 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:20.307825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-65b6fb92-9e85-4d2d-9cc9-458a733fdbd0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:20.315800 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-65b6fb92-9e85-4d2d-9cc9-458a733fdbd0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.183014 Jun 23 22:51:20.316827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 396/805] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:20 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:21.148688 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cf4e4931-fad3-49a3-b9d4-c13218f4b961 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:21.149834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cf4e4931-fad3-49a3-b9d4-c13218f4b961 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:21.152134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:21.156971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cf4e4931-fad3-49a3-b9d4-c13218f4b961 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:21.157288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cf4e4931-fad3-49a3-b9d4-c13218f4b961 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:21.158331 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cf4e4931-fad3-49a3-b9d4-c13218f4b961 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:21.158838 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cf4e4931-fad3-49a3-b9d4-c13218f4b961 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:21.226157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cf4e4931-fad3-49a3-b9d4-c13218f4b961 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:21.233614 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cf4e4931-fad3-49a3-b9d4-c13218f4b961 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1241 microversion: 2.1 time: 0.088837 Jun 23 22:51:21.236693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:21.237147 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 410/806] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:21 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:21.237255 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:21.241532 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:21.241985 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:21.242752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:21.243190 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:21.332532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1221130a-1930-45c2-908c-b760de766a38 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:21.333184 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1221130a-1930-45c2-908c-b760de766a38 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:21.339182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1221130a-1930-45c2-908c-b760de766a38 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:21.339637 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1221130a-1930-45c2-908c-b760de766a38 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:21.340397 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1221130a-1930-45c2-908c-b760de766a38 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:21.340933 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1221130a-1930-45c2-908c-b760de766a38 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:21.373898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:21.383499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:21.385046 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:21.386222 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d567df95-1f91-45d9-99ff-155001448169 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.156211 Jun 23 22:51:21.386819 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 397/807] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:21 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:21.481180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1221130a-1930-45c2-908c-b760de766a38 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:21.489647 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1221130a-1930-45c2-908c-b760de766a38 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.160916 Jun 23 22:51:21.490205 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 411/808] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:21 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:51:22.251546 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4d272586-d86d-46ba-ab23-6306c150b883 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:22.252445 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4d272586-d86d-46ba-ab23-6306c150b883 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:22.260396 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d272586-d86d-46ba-ab23-6306c150b883 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.261143 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d272586-d86d-46ba-ab23-6306c150b883 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.262017 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d272586-d86d-46ba-ab23-6306c150b883 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.262532 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4d272586-d86d-46ba-ab23-6306c150b883 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.292681 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-7e74280a-b1d4-4b97-8c03-abcf7a541336 req-20a0d3db-47a0-4d26-b6c3-237a554f4046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4088ae49-8ab6-4972-aab8-b031ca199296", "name": "network-vif-plugged", "status": "completed", "tag": "877ad78a-539d-46ac-b4ef-390cdb390092"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:22.302878 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7e74280a-b1d4-4b97-8c03-abcf7a541336 req-20a0d3db-47a0-4d26-b6c3-237a554f4046 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.303672 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7e74280a-b1d4-4b97-8c03-abcf7a541336 req-20a0d3db-47a0-4d26-b6c3-237a554f4046 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.316301 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-7e74280a-b1d4-4b97-8c03-abcf7a541336 req-20a0d3db-47a0-4d26-b6c3-237a554f4046 service nova] Creating event network-vif-plugged:877ad78a-539d-46ac-b4ef-390cdb390092 for instance 4088ae49-8ab6-4972-aab8-b031ca199296 on hv-cinder-81322 Jun 23 22:51:22.321493 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-7e74280a-b1d4-4b97-8c03-abcf7a541336 req-20a0d3db-47a0-4d26-b6c3-237a554f4046 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033009 Jun 23 22:51:22.322079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 412/809] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:51:22.352380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4d272586-d86d-46ba-ab23-6306c150b883 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:22.360395 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4d272586-d86d-46ba-ab23-6306c150b883 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1289 microversion: 2.1 time: 0.113273 Jun 23 22:51:22.360985 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 398/810] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:22 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:22.377140 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e8bfb5b7-f747-40ab-8c8d-df60c17e1254 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:22.377936 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e8bfb5b7-f747-40ab-8c8d-df60c17e1254 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:22.384218 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8bfb5b7-f747-40ab-8c8d-df60c17e1254 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.384710 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8bfb5b7-f747-40ab-8c8d-df60c17e1254 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.385552 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8bfb5b7-f747-40ab-8c8d-df60c17e1254 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.385989 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8bfb5b7-f747-40ab-8c8d-df60c17e1254 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.405188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:22.406108 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:22.413827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.414545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.415475 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.416069 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.583573 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e8bfb5b7-f747-40ab-8c8d-df60c17e1254 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:22.589047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e8bfb5b7-f747-40ab-8c8d-df60c17e1254 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1595 microversion: 2.1 time: 0.216001 Jun 23 22:51:22.589915 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 413/811] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:22 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1595 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:22.595065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c5cb6ba0-70da-4881-859f-45762c6a612b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:22.595669 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c5cb6ba0-70da-4881-859f-45762c6a612b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:22.604720 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c5cb6ba0-70da-4881-859f-45762c6a612b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.612711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c5cb6ba0-70da-4881-859f-45762c6a612b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.612711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c5cb6ba0-70da-4881-859f-45762c6a612b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:22.612711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c5cb6ba0-70da-4881-859f-45762c6a612b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:22.650618 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:22.676833 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:22.679602 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:22.681262 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f0ee3949-35e1-4d06-8008-f73cdf2fe422 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.280080 Jun 23 22:51:22.693859 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 399/812] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:22 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:22.841762 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c5cb6ba0-70da-4881-859f-45762c6a612b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:22.850357 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c5cb6ba0-70da-4881-859f-45762c6a612b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.259343 Jun 23 22:51:22.851070 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 414/813] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:22 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:23.380013 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0d108e8b-6420-4960-8ff9-9023f50b4e98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:23.381760 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0d108e8b-6420-4960-8ff9-9023f50b4e98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:23.388446 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d108e8b-6420-4960-8ff9-9023f50b4e98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:23.389232 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d108e8b-6420-4960-8ff9-9023f50b4e98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:23.390008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d108e8b-6420-4960-8ff9-9023f50b4e98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:23.390438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0d108e8b-6420-4960-8ff9-9023f50b4e98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:23.583460 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0d108e8b-6420-4960-8ff9-9023f50b4e98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:23.591703 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0d108e8b-6420-4960-8ff9-9023f50b4e98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.216753 Jun 23 22:51:23.599606 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 400/814] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:23 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:23.699862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:23.700473 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:23.708495 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:23.708992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:23.709772 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:23.713729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:23.730812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:23.867752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-31dfc53e-0409-4e82-bc32-8bc611995c70 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:23.868407 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-31dfc53e-0409-4e82-bc32-8bc611995c70 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:23.875285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31dfc53e-0409-4e82-bc32-8bc611995c70 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:23.875744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31dfc53e-0409-4e82-bc32-8bc611995c70 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:23.876515 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31dfc53e-0409-4e82-bc32-8bc611995c70 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:23.877168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-31dfc53e-0409-4e82-bc32-8bc611995c70 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:23.889939 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:23.899781 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:23.901790 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:23.902950 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6ce0d41c-08b4-482a-b527-da44a2b966bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1743 microversion: 2.20 time: 0.207079 Jun 23 22:51:23.903685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 415/815] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:23 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1743 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:24.110316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-31dfc53e-0409-4e82-bc32-8bc611995c70 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:24.118246 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-31dfc53e-0409-4e82-bc32-8bc611995c70 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1367 microversion: 2.1 time: 0.254307 Jun 23 22:51:24.118872 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 401/816] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:23 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:24.575591 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-dbb1c999-eec3-4a24-85d9-f69087328774 req-7eb0cd76-007c-4c50-a5cf-e1e84924d86a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60601697-91f9-4db0-9d49-5fdd0ff5387f", "tag": "6fd710ab-eef3-40db-a657-88d40e58e8a7"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:24.589330 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-dbb1c999-eec3-4a24-85d9-f69087328774 req-7eb0cd76-007c-4c50-a5cf-e1e84924d86a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:24.590062 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-dbb1c999-eec3-4a24-85d9-f69087328774 req-7eb0cd76-007c-4c50-a5cf-e1e84924d86a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:24.614192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-dbb1c999-eec3-4a24-85d9-f69087328774 req-7eb0cd76-007c-4c50-a5cf-e1e84924d86a service nova] Creating event network-changed:6fd710ab-eef3-40db-a657-88d40e58e8a7 for instance 60601697-91f9-4db0-9d49-5fdd0ff5387f on hv-cinder-81322 Jun 23 22:51:24.619738 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ced0a629-b854-4377-b3f7-16362788e111 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:24.620374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ced0a629-b854-4377-b3f7-16362788e111 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:24.625481 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-dbb1c999-eec3-4a24-85d9-f69087328774 req-7eb0cd76-007c-4c50-a5cf-e1e84924d86a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054288 Jun 23 22:51:24.626797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 416/817] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:24.631070 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ced0a629-b854-4377-b3f7-16362788e111 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:24.631507 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ced0a629-b854-4377-b3f7-16362788e111 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:24.633551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ced0a629-b854-4377-b3f7-16362788e111 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:24.636832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ced0a629-b854-4377-b3f7-16362788e111 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:24.892432 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ced0a629-b854-4377-b3f7-16362788e111 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:24.900832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ced0a629-b854-4377-b3f7-16362788e111 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.294950 Jun 23 22:51:24.901640 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 402/818] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:24 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:24.923206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:24.924797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:24.931513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:24.931961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:24.932758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:24.933199 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:25.119720 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:25.135047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-bbb99165-5066-447d-9ede-91677a48b835 req-ccfce8ac-ef63-43d4-a014-a4e112ae94a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8836b61b-1200-4e32-825c-c6365bded08f", "tag": "b455f4c7-2530-4f19-81ce-74ad3ad051a8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:25.143752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:25.147967 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:25.148104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-bbb99165-5066-447d-9ede-91677a48b835 req-ccfce8ac-ef63-43d4-a014-a4e112ae94a0 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:25.148104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-bbb99165-5066-447d-9ede-91677a48b835 req-ccfce8ac-ef63-43d4-a014-a4e112ae94a0 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:25.150889 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7d92f1fe-a7c7-47b4-8d01-eae33394a5d7 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1743 microversion: 2.20 time: 0.232838 Jun 23 22:51:25.151844 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 417/819] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:24 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1743 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:25.157035 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8c50184a-379e-4ee2-a6fa-0a303528537e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:25.157667 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8c50184a-379e-4ee2-a6fa-0a303528537e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:25.163658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-bbb99165-5066-447d-9ede-91677a48b835 req-ccfce8ac-ef63-43d4-a014-a4e112ae94a0 service nova] Creating event network-changed:b455f4c7-2530-4f19-81ce-74ad3ad051a8 for instance 8836b61b-1200-4e32-825c-c6365bded08f on hv-cinder-81322 Jun 23 22:51:25.167909 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8c50184a-379e-4ee2-a6fa-0a303528537e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:25.171171 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8c50184a-379e-4ee2-a6fa-0a303528537e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:25.171285 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-bbb99165-5066-447d-9ede-91677a48b835 req-ccfce8ac-ef63-43d4-a014-a4e112ae94a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039825 Jun 23 22:51:25.171484 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 403/820] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:25.175055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8c50184a-379e-4ee2-a6fa-0a303528537e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:25.175531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8c50184a-379e-4ee2-a6fa-0a303528537e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:25.374212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8c50184a-379e-4ee2-a6fa-0a303528537e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:25.383601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8c50184a-379e-4ee2-a6fa-0a303528537e tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1556 microversion: 2.1 time: 0.230337 Jun 23 22:51:25.395812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 418/821] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:25 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1556 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:25.402382 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0fb63bcf-8bee-4657-8ffb-e4a66161b1ea tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:25.410621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0fb63bcf-8bee-4657-8ffb-e4a66161b1ea tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:25.410621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fb63bcf-8bee-4657-8ffb-e4a66161b1ea tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:25.410621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fb63bcf-8bee-4657-8ffb-e4a66161b1ea tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:25.411703 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fb63bcf-8bee-4657-8ffb-e4a66161b1ea tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:25.412234 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0fb63bcf-8bee-4657-8ffb-e4a66161b1ea tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:25.577727 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0fb63bcf-8bee-4657-8ffb-e4a66161b1ea tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.179708 Jun 23 22:51:25.579032 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 404/822] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 22:51:25 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:51:25.918329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-816db341-b9fa-405a-b695-d9f65cb59706 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:25.919236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-816db341-b9fa-405a-b695-d9f65cb59706 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:25.932826 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-816db341-b9fa-405a-b695-d9f65cb59706 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:25.932826 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-816db341-b9fa-405a-b695-d9f65cb59706 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:25.933600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-816db341-b9fa-405a-b695-d9f65cb59706 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:25.936598 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-816db341-b9fa-405a-b695-d9f65cb59706 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:26.170885 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:26.172794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:26.186181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:26.190547 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:26.196097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:26.196764 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:26.401834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-816db341-b9fa-405a-b695-d9f65cb59706 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:26.417246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-816db341-b9fa-405a-b695-d9f65cb59706 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.503178 Jun 23 22:51:26.421106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 419/823] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:25 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:26.531821 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:26.544292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:26.546418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:26.547769 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3c277fe3-7a91-4853-ae6b-297d0d6dcaef tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.382598 Jun 23 22:51:26.549642 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 405/824] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:26 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:27.235183 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-12b7ac57-90b5-4c32-9488-a7bbe654cbb4 req-81552716-9ca4-49ec-93e0-9ed186064c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4088ae49-8ab6-4972-aab8-b031ca199296", "tag": "877ad78a-539d-46ac-b4ef-390cdb390092"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:27.272879 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-12b7ac57-90b5-4c32-9488-a7bbe654cbb4 req-81552716-9ca4-49ec-93e0-9ed186064c19 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:27.273329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-12b7ac57-90b5-4c32-9488-a7bbe654cbb4 req-81552716-9ca4-49ec-93e0-9ed186064c19 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:27.303991 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-12b7ac57-90b5-4c32-9488-a7bbe654cbb4 req-81552716-9ca4-49ec-93e0-9ed186064c19 service nova] Creating event network-changed:877ad78a-539d-46ac-b4ef-390cdb390092 for instance 4088ae49-8ab6-4972-aab8-b031ca199296 on hv-cinder-81322 Jun 23 22:51:27.309567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-12b7ac57-90b5-4c32-9488-a7bbe654cbb4 req-81552716-9ca4-49ec-93e0-9ed186064c19 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078000 Jun 23 22:51:27.310246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 420/825] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:27.442493 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-927892ef-bea2-4949-a7ce-598fc8955659 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:27.443926 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-927892ef-bea2-4949-a7ce-598fc8955659 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:27.466605 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-927892ef-bea2-4949-a7ce-598fc8955659 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:27.467061 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-927892ef-bea2-4949-a7ce-598fc8955659 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:27.474468 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-927892ef-bea2-4949-a7ce-598fc8955659 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:27.475168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-927892ef-bea2-4949-a7ce-598fc8955659 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:27.481958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:27.570182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:27.571342 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:27.577961 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:27.578550 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:27.579444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:27.579985 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:27.781813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:27.794673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:27.798152 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:27.800403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c97c8c6c-6758-4140-ad0a-f90c32345291 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.234807 Jun 23 22:51:27.811917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 421/826] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:27 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:27.812837 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-927892ef-bea2-4949-a7ce-598fc8955659 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:27.827630 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-927892ef-bea2-4949-a7ce-598fc8955659 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.393830 Jun 23 22:51:27.829604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 406/827] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:27 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:28.311786 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-1c1d570b-e11d-4524-9725-38fc04bd6929 req-3ac9a6fc-99b4-481a-b8c0-e61d5b2ece5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b650e20d-eaa7-4c0c-a6c1-972b92705862", "name": "network-vif-plugged", "status": "completed", "tag": "03231fbd-1795-4f15-8223-fd8df18479b9"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:28.327030 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-1c1d570b-e11d-4524-9725-38fc04bd6929 req-3ac9a6fc-99b4-481a-b8c0-e61d5b2ece5b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:28.327483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-1c1d570b-e11d-4524-9725-38fc04bd6929 req-3ac9a6fc-99b4-481a-b8c0-e61d5b2ece5b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:28.364004 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-1c1d570b-e11d-4524-9725-38fc04bd6929 req-3ac9a6fc-99b4-481a-b8c0-e61d5b2ece5b service nova] Creating event network-vif-plugged:03231fbd-1795-4f15-8223-fd8df18479b9 for instance b650e20d-eaa7-4c0c-a6c1-972b92705862 on hv-cinder-81322 Jun 23 22:51:28.378173 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-1c1d570b-e11d-4524-9725-38fc04bd6929 req-3ac9a6fc-99b4-481a-b8c0-e61d5b2ece5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069004 Jun 23 22:51:28.382048 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 422/828] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:28.821061 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:28.823383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:28.834024 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:28.834758 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:28.836203 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:28.837239 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:28.848812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c85469e1-870f-4946-98ac-092d4069671a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:28.852615 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c85469e1-870f-4946-98ac-092d4069671a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:28.863278 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c85469e1-870f-4946-98ac-092d4069671a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:28.863887 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c85469e1-870f-4946-98ac-092d4069671a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:28.864971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c85469e1-870f-4946-98ac-092d4069671a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:28.865872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c85469e1-870f-4946-98ac-092d4069671a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:29.060656 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c85469e1-870f-4946-98ac-092d4069671a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:29.070062 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c85469e1-870f-4946-98ac-092d4069671a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.225845 Jun 23 22:51:29.070648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 423/829] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:28 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:29.095693 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-edfdf521-ea61-4e4b-8454-b1b9f4e14a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1176381209"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:29.097461 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-edfdf521-ea61-4e4b-8454-b1b9f4e14a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:29.104260 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-edfdf521-ea61-4e4b-8454-b1b9f4e14a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:29.107051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-edfdf521-ea61-4e4b-8454-b1b9f4e14a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:29.107051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-edfdf521-ea61-4e4b-8454-b1b9f4e14a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:29.107051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-edfdf521-ea61-4e4b-8454-b1b9f4e14a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:29.245247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:29.254314 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:29.255837 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:29.257060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b6b6ce8d-b927-426c-9609-48da3c5d7d50 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.441631 Jun 23 22:51:29.257615 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 407/830] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:28 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:29.308338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.network.security_group_api [None req-edfdf521-ea61-4e4b-8454-b1b9f4e14a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Adding security group 0865a86d-87e9-4784-8833-96ed41b3639d to port b455f4c7-2530-4f19-81ce-74ad3ad051a8 Jun 23 22:51:30.013815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-edfdf521-ea61-4e4b-8454-b1b9f4e14a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "POST /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/action" status: 202 len: 0 microversion: 2.1 time: 0.921499 Jun 23 22:51:30.015284 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 424/831] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:51:29 2022] POST /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/action => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:51:30.025625 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7a7a5280-c8a3-4878-9909-b0d566a3237a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:30.026893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7a7a5280-c8a3-4878-9909-b0d566a3237a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:30.031297 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-8d61cc93-0efb-464b-9fea-d8f0f51f0dc0 req-65b5a6d5-da14-45df-921a-90dc28c3ff12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8836b61b-1200-4e32-825c-c6365bded08f", "tag": "b455f4c7-2530-4f19-81ce-74ad3ad051a8"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:30.034215 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:30.036792 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a7a5280-c8a3-4878-9909-b0d566a3237a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:30.037664 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a7a5280-c8a3-4878-9909-b0d566a3237a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:30.038509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a7a5280-c8a3-4878-9909-b0d566a3237a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:30.038956 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7a7a5280-c8a3-4878-9909-b0d566a3237a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:30.041594 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-8d61cc93-0efb-464b-9fea-d8f0f51f0dc0 req-65b5a6d5-da14-45df-921a-90dc28c3ff12 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:30.042293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-8d61cc93-0efb-464b-9fea-d8f0f51f0dc0 req-65b5a6d5-da14-45df-921a-90dc28c3ff12 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:30.067884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-8d61cc93-0efb-464b-9fea-d8f0f51f0dc0 req-65b5a6d5-da14-45df-921a-90dc28c3ff12 service nova] Creating event network-changed:b455f4c7-2530-4f19-81ce-74ad3ad051a8 for instance 8836b61b-1200-4e32-825c-c6365bded08f on hv-cinder-81322 Jun 23 22:51:30.073577 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-8d61cc93-0efb-464b-9fea-d8f0f51f0dc0 req-65b5a6d5-da14-45df-921a-90dc28c3ff12 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050389 Jun 23 22:51:30.074778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 425/832] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:30.089690 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-24e70184-5560-4a6c-b925-589ad3d737af tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:30.090634 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-24e70184-5560-4a6c-b925-589ad3d737af tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:30.106637 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-24e70184-5560-4a6c-b925-589ad3d737af tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:30.107498 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-24e70184-5560-4a6c-b925-589ad3d737af tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:30.108448 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-24e70184-5560-4a6c-b925-589ad3d737af tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:30.109323 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-24e70184-5560-4a6c-b925-589ad3d737af tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:30.126792 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=20 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:30.308035 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-24e70184-5560-4a6c-b925-589ad3d737af tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:30.318373 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-24e70184-5560-4a6c-b925-589ad3d737af tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.232874 Jun 23 22:51:30.332396 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 426/833] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:30 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:30.332396 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:30.332396 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:30.332923 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7a7a5280-c8a3-4878-9909-b0d566a3237a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:30.333050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:30.333458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:30.335164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:30.335775 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:30.341280 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7a7a5280-c8a3-4878-9909-b0d566a3237a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1760 microversion: 2.1 time: 0.321190 Jun 23 22:51:30.342428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 408/834] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:30 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1760 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:30.496069 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:30.505976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:30.515785 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:30.517172 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4285b576-f52b-4b7b-b851-37f27a0bcb15 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.197222 Jun 23 22:51:30.518422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 427/835] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:30 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:31.343444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-07a5d315-79e4-427b-8aad-766711b41e75 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:31.344715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-07a5d315-79e4-427b-8aad-766711b41e75 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:31.355009 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07a5d315-79e4-427b-8aad-766711b41e75 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:31.355835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07a5d315-79e4-427b-8aad-766711b41e75 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:31.356877 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07a5d315-79e4-427b-8aad-766711b41e75 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:31.357523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-07a5d315-79e4-427b-8aad-766711b41e75 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:31.521080 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-07a5d315-79e4-427b-8aad-766711b41e75 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:31.535282 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-07a5d315-79e4-427b-8aad-766711b41e75 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.195804 Jun 23 22:51:31.535872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:31.536485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:31.538035 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 409/836] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:31 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:31.546833 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:31.550707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:31.551556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:31.552066 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:31.699420 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:31.709675 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:31.711478 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:31.713090 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5fe25302-c3fd-4ec1-9adc-3811c61a0751 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.181368 Jun 23 22:51:31.714450 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 428/837] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:31 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:32.520784 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-fa7866c0-a15e-4aa6-9e2d-2209102fb54c req-de40e94e-d65c-4b4e-842c-869fcf33c210 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60601697-91f9-4db0-9d49-5fdd0ff5387f", "name": "network-vif-plugged", "status": "completed", "tag": "6fd710ab-eef3-40db-a657-88d40e58e8a7"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:32.533029 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-fa7866c0-a15e-4aa6-9e2d-2209102fb54c req-de40e94e-d65c-4b4e-842c-869fcf33c210 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:32.541168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-fa7866c0-a15e-4aa6-9e2d-2209102fb54c req-de40e94e-d65c-4b4e-842c-869fcf33c210 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:32.554513 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-fa7866c0-a15e-4aa6-9e2d-2209102fb54c req-de40e94e-d65c-4b4e-842c-869fcf33c210 service nova] Creating event network-vif-plugged:6fd710ab-eef3-40db-a657-88d40e58e8a7 for instance 60601697-91f9-4db0-9d49-5fdd0ff5387f on hv-cinder-81322 Jun 23 22:51:32.555786 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a580c5de-8999-424d-b638-5cad51ba5702 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:32.556795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a580c5de-8999-424d-b638-5cad51ba5702 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:32.562689 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-fa7866c0-a15e-4aa6-9e2d-2209102fb54c req-de40e94e-d65c-4b4e-842c-869fcf33c210 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047872 Jun 23 22:51:32.563910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 410/838] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:51:32.583718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a580c5de-8999-424d-b638-5cad51ba5702 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:32.584321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a580c5de-8999-424d-b638-5cad51ba5702 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:32.585143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a580c5de-8999-424d-b638-5cad51ba5702 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:32.585572 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a580c5de-8999-424d-b638-5cad51ba5702 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:32.735238 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:32.736618 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:32.746703 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:32.747577 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:32.748662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:32.749298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:32.759554 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a580c5de-8999-424d-b638-5cad51ba5702 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:32.771818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a580c5de-8999-424d-b638-5cad51ba5702 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.220850 Jun 23 22:51:32.774817 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 429/839] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:32 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:32.968464 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:32.980822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:32.982597 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:32.984266 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-77f4df80-9a30-49c6-838e-3971defa9a38 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.254726 Jun 23 22:51:32.999147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 411/840] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:32 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:33.790754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9dc1aa9f-4e5d-4c15-8d17-7c23a93d2c6a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:33.791624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9dc1aa9f-4e5d-4c15-8d17-7c23a93d2c6a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:33.798935 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9dc1aa9f-4e5d-4c15-8d17-7c23a93d2c6a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:33.799387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9dc1aa9f-4e5d-4c15-8d17-7c23a93d2c6a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:33.800177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9dc1aa9f-4e5d-4c15-8d17-7c23a93d2c6a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:33.800624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9dc1aa9f-4e5d-4c15-8d17-7c23a93d2c6a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:33.957293 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9dc1aa9f-4e5d-4c15-8d17-7c23a93d2c6a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:33.965548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9dc1aa9f-4e5d-4c15-8d17-7c23a93d2c6a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1363 microversion: 2.1 time: 0.180655 Jun 23 22:51:33.976019 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 430/841] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:33 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:51:34.003791 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:34.004408 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:34.013189 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:34.014049 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:34.015006 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:34.015609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:34.165615 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:34.179807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:34.181455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:34.182752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7966eb5d-1251-4a97-b25b-e3856cb774bd tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.183317 Jun 23 22:51:34.183408 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 412/842] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:33 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:34.985928 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-70879019-fb37-432d-9fd8-38a2408ae22e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:35.049951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-70879019-fb37-432d-9fd8-38a2408ae22e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:35.049951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-70879019-fb37-432d-9fd8-38a2408ae22e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:35.049951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-70879019-fb37-432d-9fd8-38a2408ae22e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:35.049951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-70879019-fb37-432d-9fd8-38a2408ae22e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:35.050344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-70879019-fb37-432d-9fd8-38a2408ae22e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:35.164616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-70879019-fb37-432d-9fd8-38a2408ae22e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:35.172918 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-70879019-fb37-432d-9fd8-38a2408ae22e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1549 microversion: 2.1 time: 0.193446 Jun 23 22:51:35.184715 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 431/843] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:34 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1549 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:35.190354 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-675a3b6a-51b3-4723-9bb8-c0b6bdd56cea tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:35.192995 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-675a3b6a-51b3-4723-9bb8-c0b6bdd56cea tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:35.199992 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-675a3b6a-51b3-4723-9bb8-c0b6bdd56cea tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:35.200451 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-675a3b6a-51b3-4723-9bb8-c0b6bdd56cea tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:35.201255 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-675a3b6a-51b3-4723-9bb8-c0b6bdd56cea tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:35.201716 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-675a3b6a-51b3-4723-9bb8-c0b6bdd56cea tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:35.202835 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:35.203448 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:35.211910 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:35.212495 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:35.213344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:35.213781 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:35.301460 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-675a3b6a-51b3-4723-9bb8-c0b6bdd56cea tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115732 Jun 23 22:51:35.302591 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 413/844] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 22:51:35 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:35.390716 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:35.400953 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:35.402656 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:35.403837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a6b03ae2-407f-4e21-b0cc-603e560d1f01 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.205023 Jun 23 22:51:35.404396 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 432/845] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:35 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:36.457411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-b09e7aea-f33e-4d69-a0a5-447460cdd355 req-bc8b3eaa-f6b1-4170-86a9-bce873b78172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60601697-91f9-4db0-9d49-5fdd0ff5387f", "tag": "6fd710ab-eef3-40db-a657-88d40e58e8a7"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:36.457411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-b09e7aea-f33e-4d69-a0a5-447460cdd355 req-bc8b3eaa-f6b1-4170-86a9-bce873b78172 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:36.457411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-b09e7aea-f33e-4d69-a0a5-447460cdd355 req-bc8b3eaa-f6b1-4170-86a9-bce873b78172 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:36.457411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-b09e7aea-f33e-4d69-a0a5-447460cdd355 req-bc8b3eaa-f6b1-4170-86a9-bce873b78172 service nova] Creating event network-changed:6fd710ab-eef3-40db-a657-88d40e58e8a7 for instance 60601697-91f9-4db0-9d49-5fdd0ff5387f on hv-cinder-81322 Jun 23 22:51:36.459729 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-b09e7aea-f33e-4d69-a0a5-447460cdd355 req-bc8b3eaa-f6b1-4170-86a9-bce873b78172 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029773 Jun 23 22:51:36.459729 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 414/846] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:36.460552 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:36.460552 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:36.460552 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:36.460552 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:36.461217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:36.461217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:36.581590 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:36.592269 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:36.593890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:36.596142 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-de4bec9b-92dc-431a-aada-750c30caf1e1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.176761 Jun 23 22:51:36.606737 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 433/847] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:36 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:37.615745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:37.616490 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:37.623086 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:37.623677 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:37.624445 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:37.624912 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:37.757752 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:37.765842 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:37.767986 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:37.769199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2ef3a8cc-f78b-4f68-b2a0-6a16f02108ee tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1738 microversion: 2.20 time: 0.159155 Jun 23 22:51:37.769765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 415/848] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:37 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:51:38.788470 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:38.789130 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:38.795611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:38.796071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:38.796853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:38.797294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:38.931407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:38.940318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:38.941857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:38.943078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d1253a15-7e4d-46af-9720-1d6689588563 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1720 microversion: 2.20 time: 0.158847 Jun 23 22:51:38.943640 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 434/849] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:38 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:39.961603 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:39.962151 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:39.968622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:39.969071 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:39.969819 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:39.970256 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:40.103083 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:40.111266 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:40.112794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:40.114008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-204b13a9-087c-4cb5-942a-a75ceafc3b1f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1720 microversion: 2.20 time: 0.156402 Jun 23 22:51:40.114558 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 416/850] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:39 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:40.404687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-c7c98873-c0b1-4168-b07f-6b7c3af3e5d4 req-30329e79-912c-4d74-ae81-9cfaa179a21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b650e20d-eaa7-4c0c-a6c1-972b92705862", "name": "network-vif-unplugged", "status": "completed", "tag": "03231fbd-1795-4f15-8223-fd8df18479b9"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:40.413501 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-c7c98873-c0b1-4168-b07f-6b7c3af3e5d4 req-30329e79-912c-4d74-ae81-9cfaa179a21a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:40.413945 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-c7c98873-c0b1-4168-b07f-6b7c3af3e5d4 req-30329e79-912c-4d74-ae81-9cfaa179a21a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:40.417648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=100 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:40.424555 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-c7c98873-c0b1-4168-b07f-6b7c3af3e5d4 req-30329e79-912c-4d74-ae81-9cfaa179a21a service nova] Creating event network-vif-unplugged:03231fbd-1795-4f15-8223-fd8df18479b9 for instance b650e20d-eaa7-4c0c-a6c1-972b92705862 on hv-cinder-81322 Jun 23 22:51:40.429310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-c7c98873-c0b1-4168-b07f-6b7c3af3e5d4 req-30329e79-912c-4d74-ae81-9cfaa179a21a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028364 Jun 23 22:51:40.429867 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 435/851] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:51:41.132084 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:41.132757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:41.139200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:41.139646 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:41.140697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:41.141131 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:41.270497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:41.278633 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:41.280141 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:41.281423 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a6c024b7-88b3-4c32-ad40-b45b95ffe2bf tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1720 microversion: 2.20 time: 0.153215 Jun 23 22:51:41.281979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 417/852] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:41 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:42.301887 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:42.302587 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:42.308868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:42.309321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:42.310073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:42.310508 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:42.442459 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:42.450268 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:42.451800 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:42.452968 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2c8b5de4-a407-42d4-b0a5-137603a9bd7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1663 microversion: 2.20 time: 0.156865 Jun 23 22:51:42.453514 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 436/853] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:42 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:42.471551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b58bdeda-3eff-4f60-b1e9-57c9fac54025 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2b540cc-5103-45d0-bf9a-cf9c8c6fab33"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:42.472624 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b58bdeda-3eff-4f60-b1e9-57c9fac54025 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:42.479365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b58bdeda-3eff-4f60-b1e9-57c9fac54025 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:42.479819 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b58bdeda-3eff-4f60-b1e9-57c9fac54025 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:42.480594 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b58bdeda-3eff-4f60-b1e9-57c9fac54025 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:42.481030 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b58bdeda-3eff-4f60-b1e9-57c9fac54025 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:43.395719 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b58bdeda-3eff-4f60-b1e9-57c9fac54025 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.928720 Jun 23 22:51:43.396332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 418/854] 10.222.0.33 () {62 vars in 1363 bytes} [Thu Jun 23 22:51:42 2022] POST /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/os-volume_attachments => generated 188 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 22:51:43.517262 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-226f6eb9-85cb-4be5-bef4-28d21b22a649 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:43.517758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-226f6eb9-85cb-4be5-bef4-28d21b22a649 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:43.524179 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-226f6eb9-85cb-4be5-bef4-28d21b22a649 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:43.524657 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-226f6eb9-85cb-4be5-bef4-28d21b22a649 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:43.525406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-226f6eb9-85cb-4be5-bef4-28d21b22a649 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:43.525837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-226f6eb9-85cb-4be5-bef4-28d21b22a649 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:44.090507 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-226f6eb9-85cb-4be5-bef4-28d21b22a649 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/os-volume_attachments/d2b540cc-5103-45d0-bf9a-cf9c8c6fab33" status: 202 len: 0 microversion: 2.20 time: 0.577202 Jun 23 22:51:44.091122 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 437/855] 10.222.0.33 () {60 vars in 1456 bytes} [Thu Jun 23 22:51:43 2022] DELETE /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/os-volume_attachments/d2b540cc-5103-45d0-bf9a-cf9c8c6fab33 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:51:44.147185 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-21d506ed-72f1-4fcf-85d1-b309cff7d4ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:44.152275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-21d506ed-72f1-4fcf-85d1-b309cff7d4ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:44.154249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21d506ed-72f1-4fcf-85d1-b309cff7d4ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:44.154701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21d506ed-72f1-4fcf-85d1-b309cff7d4ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:44.155451 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21d506ed-72f1-4fcf-85d1-b309cff7d4ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:44.155890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21d506ed-72f1-4fcf-85d1-b309cff7d4ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:44.374782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-21d506ed-72f1-4fcf-85d1-b309cff7d4ac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "POST /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/action" status: 202 len: 0 microversion: 2.20 time: 0.232045 Jun 23 22:51:44.375634 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 419/856] 10.222.0.33 () {62 vars in 1318 bytes} [Thu Jun 23 22:51:44 2022] POST /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:51:44.384338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:44.385755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:44.391878 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:44.393049 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:44.393884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:44.394314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:44.525231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:44.533480 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:44.544724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:44.544724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8956f530-0576-404c-8220-900d76170e13 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1671 microversion: 2.20 time: 0.155840 Jun 23 22:51:44.544724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 438/857] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:44 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:45.558190 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:45.558761 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:45.565606 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:45.566058 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:45.566818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:45.567254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:45.696688 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:45.700202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:45.705173 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:45.706895 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:45.708066 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a63f4f62-68e6-487c-b925-d41f5767c132 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1673 microversion: 2.20 time: 0.154434 Jun 23 22:51:45.708649 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 420/858] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:45 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:46.727127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:46.727757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:46.734519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:46.734969 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:46.736568 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:46.737059 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:46.873337 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:46.881840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:46.883338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:46.884483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a10d40db-0ee1-43cf-8712-658403286fe9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.161319 Jun 23 22:51:46.885057 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 439/859] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:46 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:47.903143 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:47.903736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:47.906914 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=76 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:47.912911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:47.913436 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:47.914218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:47.914650 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:48.057836 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:48.067536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:48.069254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:48.070424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-55ac892d-baf7-4b39-acab-052ced731612 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.171159 Jun 23 22:51:48.070987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 421/860] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:47 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:49.089412 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:49.090024 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:49.096966 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:49.097758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:49.098285 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:49.098681 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:49.237921 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:49.246448 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:49.252025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:49.252025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9dfcf444-a215-4693-8514-43171df92eac tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.163655 Jun 23 22:51:49.252025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 440/861] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:49 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:50.270054 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:50.271037 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:50.278032 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:50.278484 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:50.279259 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:50.279698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:50.647677 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:50.656609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:50.658104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:50.659304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-13adcd18-3e1c-4e33-90ed-11b6aea3ffed tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.395067 Jun 23 22:51:50.660826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 422/862] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:50 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:51.678035 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:51.678658 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:51.681339 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=62 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:51:51.686484 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:51.686939 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:51.687712 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:51.688150 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:51.837319 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:51.846170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:51.849217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:51.850772 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f905932f-df30-410d-9375-631051ebecc0 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.177054 Jun 23 22:51:51.855060 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 441/863] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:51 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:52.869864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:52.919097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:52.919097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:52.919097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:52.919097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:52.919573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:53.016517 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:53.025375 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:53.026887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:53.028048 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-856ff3b6-a6cc-4238-8c35-6269ffb78de1 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.162353 Jun 23 22:51:53.028826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 423/864] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:52 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:53.067597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-85b67b53-61d7-4d0f-8346-9913d01c514f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:51:53.068779 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-85b67b53-61d7-4d0f-8346-9913d01c514f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:53.075578 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-85b67b53-61d7-4d0f-8346-9913d01c514f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:53.076033 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-85b67b53-61d7-4d0f-8346-9913d01c514f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:53.076835 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-85b67b53-61d7-4d0f-8346-9913d01c514f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:53.077273 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-85b67b53-61d7-4d0f-8346-9913d01c514f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:53.289633 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-85b67b53-61d7-4d0f-8346-9913d01c514f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "POST /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/action" status: 202 len: 0 microversion: 2.1 time: 0.226555 Jun 23 22:51:53.290601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 442/865] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:51:53 2022] POST /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:51:53.298495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-efe0767b-24dc-4fb6-9ad1-7fe9986ec290 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:53.299101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-efe0767b-24dc-4fb6-9ad1-7fe9986ec290 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:53.305483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efe0767b-24dc-4fb6-9ad1-7fe9986ec290 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:53.306016 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efe0767b-24dc-4fb6-9ad1-7fe9986ec290 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:53.306750 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efe0767b-24dc-4fb6-9ad1-7fe9986ec290 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:53.307191 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efe0767b-24dc-4fb6-9ad1-7fe9986ec290 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:53.464635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-efe0767b-24dc-4fb6-9ad1-7fe9986ec290 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:53.472724 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-efe0767b-24dc-4fb6-9ad1-7fe9986ec290 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1752 microversion: 2.1 time: 0.178080 Jun 23 22:51:53.473298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 424/866] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:53 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:54.047521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:54.048241 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:54.056875 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:54.057329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:54.058109 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:54.058548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:54.203296 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:54.213696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:54.215568 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:54.216828 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-23906c4a-270d-48c1-aed5-0ec941a9353c tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.173661 Jun 23 22:51:54.217654 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 443/867] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:54 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:54.491935 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-72c6d5f4-4313-46fe-883d-5b67c9d5d8f2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:54.492714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-72c6d5f4-4313-46fe-883d-5b67c9d5d8f2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:54.499743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-72c6d5f4-4313-46fe-883d-5b67c9d5d8f2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:54.500155 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-72c6d5f4-4313-46fe-883d-5b67c9d5d8f2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:54.500968 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-72c6d5f4-4313-46fe-883d-5b67c9d5d8f2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:54.501399 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-72c6d5f4-4313-46fe-883d-5b67c9d5d8f2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:54.648642 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-72c6d5f4-4313-46fe-883d-5b67c9d5d8f2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:54.657034 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-72c6d5f4-4313-46fe-883d-5b67c9d5d8f2 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1752 microversion: 2.1 time: 0.169521 Jun 23 22:51:54.657644 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 425/868] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:54 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:55.318159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:55.318159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:55.318159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:55.318159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:55.319965 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:55.319965 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:55.421383 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:55.437792 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:55.439879 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:55.442077 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f314ab0e-f832-4a85-9aa7-fc79446f7741 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.210550 Jun 23 22:51:55.452837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 444/869] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:55 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:55.674471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e2f2d45c-169d-45ce-bd49-e788e16ce2b8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:55.675696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e2f2d45c-169d-45ce-bd49-e788e16ce2b8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:55.682129 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2f2d45c-169d-45ce-bd49-e788e16ce2b8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:55.682589 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2f2d45c-169d-45ce-bd49-e788e16ce2b8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:55.683373 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2f2d45c-169d-45ce-bd49-e788e16ce2b8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:55.683818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2f2d45c-169d-45ce-bd49-e788e16ce2b8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:55.831741 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e2f2d45c-169d-45ce-bd49-e788e16ce2b8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:55.840111 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e2f2d45c-169d-45ce-bd49-e788e16ce2b8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1752 microversion: 2.1 time: 0.169621 Jun 23 22:51:55.840710 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 426/870] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:55 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:56.482862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:56.482862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:56.482862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:56.482862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:56.483793 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:56.483793 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:56.616073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:56.625564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:56.627093 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:56.628759 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ee547b8b-3f40-4bc4-b257-d98e3c7747f3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.170071 Jun 23 22:51:56.629325 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 445/871] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:56 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:56.856709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6969adad-c846-4fc7-8820-19f82e41769b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:56.857341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6969adad-c846-4fc7-8820-19f82e41769b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:56.864365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6969adad-c846-4fc7-8820-19f82e41769b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:56.864843 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6969adad-c846-4fc7-8820-19f82e41769b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:56.865702 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6969adad-c846-4fc7-8820-19f82e41769b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:56.866144 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6969adad-c846-4fc7-8820-19f82e41769b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:57.013274 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6969adad-c846-4fc7-8820-19f82e41769b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:57.021996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6969adad-c846-4fc7-8820-19f82e41769b tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1752 microversion: 2.1 time: 0.169134 Jun 23 22:51:57.028154 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 427/872] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:56 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:57.646611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:57.647148 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:57.653850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:57.654295 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:57.655041 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:57.655468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:57.782918 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:57.791488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:57.793000 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:57.794144 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cfb0cab6-a9e6-4e27-b042-2f15882e2779 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.151912 Jun 23 22:51:57.794686 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 446/873] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:57 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:58.039692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3cb4b9ad-5bee-4314-af8c-2f4502d0a71f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:58.040292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3cb4b9ad-5bee-4314-af8c-2f4502d0a71f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:58.047045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3cb4b9ad-5bee-4314-af8c-2f4502d0a71f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:58.047527 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3cb4b9ad-5bee-4314-af8c-2f4502d0a71f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:58.048300 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3cb4b9ad-5bee-4314-af8c-2f4502d0a71f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:58.048773 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3cb4b9ad-5bee-4314-af8c-2f4502d0a71f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:58.189450 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3cb4b9ad-5bee-4314-af8c-2f4502d0a71f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:58.197701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3cb4b9ad-5bee-4314-af8c-2f4502d0a71f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1752 microversion: 2.1 time: 0.161817 Jun 23 22:51:58.198263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 428/874] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:58 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:58.812200 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:58.812799 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:58.820295 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:58.820794 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:58.821569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:58.822002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:58.951559 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:58.959671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:58.961238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:58.962399 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c2db3c00-5596-4067-8775-af9ebacbe4fa tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.154218 Jun 23 22:51:58.963010 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 447/875] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:58 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:51:59.215228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2b64da39-b7e0-43cd-9bbd-10c63d80c471 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:59.215842 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2b64da39-b7e0-43cd-9bbd-10c63d80c471 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:59.223724 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b64da39-b7e0-43cd-9bbd-10c63d80c471 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:59.224379 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b64da39-b7e0-43cd-9bbd-10c63d80c471 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:59.225500 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b64da39-b7e0-43cd-9bbd-10c63d80c471 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:59.226027 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b64da39-b7e0-43cd-9bbd-10c63d80c471 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:59.370266 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2b64da39-b7e0-43cd-9bbd-10c63d80c471 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:51:59.378161 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2b64da39-b7e0-43cd-9bbd-10c63d80c471 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.166821 Jun 23 22:51:59.378715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 429/876] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:51:59 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:51:59.979765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:51:59.980374 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:51:59.987239 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:59.987693 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:51:59.988450 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:51:59.988912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:00.114937 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:00.118448 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:00.123449 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:00.124979 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:00.126181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9f3cfadf-7a37-4d2c-9b63-3c6cf8849e86 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.150270 Jun 23 22:52:00.126727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 448/877] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:51:59 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:52:00.395102 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-cacc493f-fd0e-4492-8a1a-9c41bf5f61ff tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:00.395739 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-cacc493f-fd0e-4492-8a1a-9c41bf5f61ff tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:00.402223 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cacc493f-fd0e-4492-8a1a-9c41bf5f61ff tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:00.402674 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cacc493f-fd0e-4492-8a1a-9c41bf5f61ff tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:00.403419 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cacc493f-fd0e-4492-8a1a-9c41bf5f61ff tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:00.403853 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-cacc493f-fd0e-4492-8a1a-9c41bf5f61ff tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:00.542914 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-cacc493f-fd0e-4492-8a1a-9c41bf5f61ff tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:00.551924 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-cacc493f-fd0e-4492-8a1a-9c41bf5f61ff tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.160632 Jun 23 22:52:00.552497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 430/878] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:00 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:01.145696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:01.146222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:01.153101 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:01.153548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:01.154301 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:01.154732 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:01.282302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:01.291102 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:01.292608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:01.293760 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-db017c9f-528a-4dfb-82e9-14f314f98667 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.153109 Jun 23 22:52:01.294312 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 449/879] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:01 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:52:01.569499 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2cee7db7-bf84-4e7d-9efe-d086cf3b4f08 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:01.570105 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2cee7db7-bf84-4e7d-9efe-d086cf3b4f08 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:01.576521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2cee7db7-bf84-4e7d-9efe-d086cf3b4f08 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:01.577016 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2cee7db7-bf84-4e7d-9efe-d086cf3b4f08 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:01.577797 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2cee7db7-bf84-4e7d-9efe-d086cf3b4f08 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:01.578228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2cee7db7-bf84-4e7d-9efe-d086cf3b4f08 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:01.717629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2cee7db7-bf84-4e7d-9efe-d086cf3b4f08 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:01.725538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2cee7db7-bf84-4e7d-9efe-d086cf3b4f08 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.160575 Jun 23 22:52:01.726099 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 431/880] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:01 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:02.311375 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:02.311987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:02.319426 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:02.322113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:02.322113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:02.322113 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:02.453090 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:02.461270 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:02.462849 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:02.464127 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-35518cb5-1643-4c08-b619-0d346bb6b365 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.156779 Jun 23 22:52:02.464821 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 450/881] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:02 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:52:02.564632 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-6d91f66d-6776-4e53-bf2d-456e87898d40 req-dbdc2459-2e51-486a-bca5-c5dab5b7decf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b650e20d-eaa7-4c0c-a6c1-972b92705862", "name": "network-vif-plugged", "status": "completed", "tag": "03231fbd-1795-4f15-8223-fd8df18479b9"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:02.574714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-6d91f66d-6776-4e53-bf2d-456e87898d40 req-dbdc2459-2e51-486a-bca5-c5dab5b7decf service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:02.575335 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-6d91f66d-6776-4e53-bf2d-456e87898d40 req-dbdc2459-2e51-486a-bca5-c5dab5b7decf service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:02.587015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-6d91f66d-6776-4e53-bf2d-456e87898d40 req-dbdc2459-2e51-486a-bca5-c5dab5b7decf service nova] Creating event network-vif-plugged:03231fbd-1795-4f15-8223-fd8df18479b9 for instance b650e20d-eaa7-4c0c-a6c1-972b92705862 on hv-cinder-81322 Jun 23 22:52:02.592216 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-6d91f66d-6776-4e53-bf2d-456e87898d40 req-dbdc2459-2e51-486a-bca5-c5dab5b7decf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031878 Jun 23 22:52:02.592840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 432/882] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:52:02.743199 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-993ed32e-5234-4572-a0b1-d061745ffa48 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:02.743812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-993ed32e-5234-4572-a0b1-d061745ffa48 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:02.749811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-993ed32e-5234-4572-a0b1-d061745ffa48 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:02.750264 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-993ed32e-5234-4572-a0b1-d061745ffa48 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:02.751016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-993ed32e-5234-4572-a0b1-d061745ffa48 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:02.751449 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-993ed32e-5234-4572-a0b1-d061745ffa48 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:02.898247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-993ed32e-5234-4572-a0b1-d061745ffa48 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:02.906364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-993ed32e-5234-4572-a0b1-d061745ffa48 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.166994 Jun 23 22:52:02.907134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 451/883] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:02 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:03.483179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:03.483876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:03.490996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:03.491443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:03.492196 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:03.492654 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:03.621255 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:03.629171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:03.630666 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:03.631822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-88853e5d-5155-420a-a27f-79fdacf5bee4 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.153189 Jun 23 22:52:03.632380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 433/884] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:03 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:52:03.924093 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0ccbe428-34ec-4441-a6b1-b088f6ed110f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:03.925411 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0ccbe428-34ec-4441-a6b1-b088f6ed110f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:03.932009 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0ccbe428-34ec-4441-a6b1-b088f6ed110f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:03.932462 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0ccbe428-34ec-4441-a6b1-b088f6ed110f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:03.933248 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0ccbe428-34ec-4441-a6b1-b088f6ed110f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:03.933684 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0ccbe428-34ec-4441-a6b1-b088f6ed110f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:04.073386 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0ccbe428-34ec-4441-a6b1-b088f6ed110f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:04.081947 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0ccbe428-34ec-4441-a6b1-b088f6ed110f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.161771 Jun 23 22:52:04.082511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 452/885] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:03 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:04.649955 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:04.650563 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:04.657147 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:04.657601 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:04.658356 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:04.659273 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:04.793768 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:04.801800 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:04.803298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:04.804459 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5e7b05e0-3a48-428f-88a8-e6a4b5393a7d tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1729 microversion: 2.20 time: 0.158496 Jun 23 22:52:04.807824 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 434/886] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:04 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:52:05.098621 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3bd6f996-a9fe-4b8f-83de-e9b2b82fa618 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:05.099152 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3bd6f996-a9fe-4b8f-83de-e9b2b82fa618 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:05.105595 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3bd6f996-a9fe-4b8f-83de-e9b2b82fa618 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:05.106043 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3bd6f996-a9fe-4b8f-83de-e9b2b82fa618 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:05.106788 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3bd6f996-a9fe-4b8f-83de-e9b2b82fa618 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:05.107474 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3bd6f996-a9fe-4b8f-83de-e9b2b82fa618 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:05.247005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3bd6f996-a9fe-4b8f-83de-e9b2b82fa618 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:05.255859 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3bd6f996-a9fe-4b8f-83de-e9b2b82fa618 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.161251 Jun 23 22:52:05.256423 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 453/887] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:05 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:05.822825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:05.823363 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:05.829826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:05.830269 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:05.831769 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:05.832203 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:05.957398 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:05.965315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:05.966855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:05.968011 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e96b978e-7d84-4db1-b7aa-481405d5536a tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1716 microversion: 2.20 time: 0.149234 Jun 23 22:52:05.968565 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 435/888] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:05 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:52:06.272841 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6fb78540-d844-46b9-8441-2c6fdc3d7c0f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:06.273452 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6fb78540-d844-46b9-8441-2c6fdc3d7c0f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:06.279917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6fb78540-d844-46b9-8441-2c6fdc3d7c0f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:06.280365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6fb78540-d844-46b9-8441-2c6fdc3d7c0f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:06.281154 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6fb78540-d844-46b9-8441-2c6fdc3d7c0f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:06.281593 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6fb78540-d844-46b9-8441-2c6fdc3d7c0f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:06.421657 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6fb78540-d844-46b9-8441-2c6fdc3d7c0f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:06.430158 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6fb78540-d844-46b9-8441-2c6fdc3d7c0f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.161207 Jun 23 22:52:06.430716 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 454/889] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:06 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:07.447097 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-44fd4600-985c-46af-bbb1-05a1cf4c8a04 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:07.447699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-44fd4600-985c-46af-bbb1-05a1cf4c8a04 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:07.454254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fd4600-985c-46af-bbb1-05a1cf4c8a04 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:07.454697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fd4600-985c-46af-bbb1-05a1cf4c8a04 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:07.455444 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fd4600-985c-46af-bbb1-05a1cf4c8a04 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:07.456619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-44fd4600-985c-46af-bbb1-05a1cf4c8a04 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:07.598055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-44fd4600-985c-46af-bbb1-05a1cf4c8a04 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:07.605958 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-44fd4600-985c-46af-bbb1-05a1cf4c8a04 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.162740 Jun 23 22:52:07.606515 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 436/890] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:07 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:08.676166 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fc904944-7853-47d4-ad29-14ff0072588a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:08.676815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fc904944-7853-47d4-ad29-14ff0072588a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:08.683027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc904944-7853-47d4-ad29-14ff0072588a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:08.683470 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc904944-7853-47d4-ad29-14ff0072588a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:08.684250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc904944-7853-47d4-ad29-14ff0072588a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:08.684716 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc904944-7853-47d4-ad29-14ff0072588a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:08.827829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-fc904944-7853-47d4-ad29-14ff0072588a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:08.836381 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fc904944-7853-47d4-ad29-14ff0072588a tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.164129 Jun 23 22:52:08.836967 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 455/891] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:08 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:09.853392 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5b345263-8a6c-4d8f-b13b-39b934c099b1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:09.854030 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5b345263-8a6c-4d8f-b13b-39b934c099b1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:09.860875 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b345263-8a6c-4d8f-b13b-39b934c099b1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:09.861320 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b345263-8a6c-4d8f-b13b-39b934c099b1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:09.862871 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b345263-8a6c-4d8f-b13b-39b934c099b1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:09.863305 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5b345263-8a6c-4d8f-b13b-39b934c099b1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:09.998860 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5b345263-8a6c-4d8f-b13b-39b934c099b1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:10.006814 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5b345263-8a6c-4d8f-b13b-39b934c099b1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.157314 Jun 23 22:52:10.007374 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 437/892] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:09 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:11.023807 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a12a4b29-5b3f-4f29-ad07-a61e154cc14f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:11.024415 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a12a4b29-5b3f-4f29-ad07-a61e154cc14f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:11.030916 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a12a4b29-5b3f-4f29-ad07-a61e154cc14f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:11.031364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a12a4b29-5b3f-4f29-ad07-a61e154cc14f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:11.032110 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a12a4b29-5b3f-4f29-ad07-a61e154cc14f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:11.032551 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a12a4b29-5b3f-4f29-ad07-a61e154cc14f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:11.171953 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a12a4b29-5b3f-4f29-ad07-a61e154cc14f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:11.180718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a12a4b29-5b3f-4f29-ad07-a61e154cc14f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.160795 Jun 23 22:52:11.181281 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 456/893] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:11 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:12.197908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-94cc8015-3fb6-4e2d-83d8-08ce11b505e5 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:12.198433 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-94cc8015-3fb6-4e2d-83d8-08ce11b505e5 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:12.204983 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94cc8015-3fb6-4e2d-83d8-08ce11b505e5 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:12.205435 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94cc8015-3fb6-4e2d-83d8-08ce11b505e5 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:12.206189 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94cc8015-3fb6-4e2d-83d8-08ce11b505e5 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:12.206623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94cc8015-3fb6-4e2d-83d8-08ce11b505e5 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:12.210616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:12.354464 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-94cc8015-3fb6-4e2d-83d8-08ce11b505e5 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:12.363399 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-94cc8015-3fb6-4e2d-83d8-08ce11b505e5 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.169451 Jun 23 22:52:12.363954 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 438/894] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:12 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:13.380530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4c4da492-043e-4e76-9771-843e0899f3c9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:13.381181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4c4da492-043e-4e76-9771-843e0899f3c9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:13.387758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c4da492-043e-4e76-9771-843e0899f3c9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:13.388216 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c4da492-043e-4e76-9771-843e0899f3c9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:13.389011 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c4da492-043e-4e76-9771-843e0899f3c9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:13.389457 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c4da492-043e-4e76-9771-843e0899f3c9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:13.530366 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4c4da492-043e-4e76-9771-843e0899f3c9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:13.538873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4c4da492-043e-4e76-9771-843e0899f3c9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.162233 Jun 23 22:52:13.539433 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 457/895] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:13 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:14.219042 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d83c76ff-cc16-4b3d-bfaa-d4c134fe7e99 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:14.219631 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d83c76ff-cc16-4b3d-bfaa-d4c134fe7e99 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:14.226412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d83c76ff-cc16-4b3d-bfaa-d4c134fe7e99 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:14.226868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d83c76ff-cc16-4b3d-bfaa-d4c134fe7e99 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:14.227625 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d83c76ff-cc16-4b3d-bfaa-d4c134fe7e99 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:14.228060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d83c76ff-cc16-4b3d-bfaa-d4c134fe7e99 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:14.251066 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d83c76ff-cc16-4b3d-bfaa-d4c134fe7e99 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/ips" status: 200 len: 148 microversion: 2.1 time: 0.035905 Jun 23 22:52:14.251625 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 439/896] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:52:14 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:52:14.555978 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0000b540-5136-4ec2-848c-debb9380dca4 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:14.556616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0000b540-5136-4ec2-848c-debb9380dca4 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:14.563244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0000b540-5136-4ec2-848c-debb9380dca4 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:14.563685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0000b540-5136-4ec2-848c-debb9380dca4 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:14.564438 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0000b540-5136-4ec2-848c-debb9380dca4 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:14.565579 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0000b540-5136-4ec2-848c-debb9380dca4 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:14.708938 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0000b540-5136-4ec2-848c-debb9380dca4 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:14.717862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0000b540-5136-4ec2-848c-debb9380dca4 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.165795 Jun 23 22:52:14.718474 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 458/897] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:14 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:15.736053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5e92750c-4955-44a1-9fda-a1539060b4dd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:15.737016 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5e92750c-4955-44a1-9fda-a1539060b4dd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:15.743427 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e92750c-4955-44a1-9fda-a1539060b4dd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:15.743884 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e92750c-4955-44a1-9fda-a1539060b4dd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:15.744668 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e92750c-4955-44a1-9fda-a1539060b4dd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:15.745109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5e92750c-4955-44a1-9fda-a1539060b4dd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:15.803228 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d8d1cc55-55d0-4bc3-b896-f593891bc34b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29447b4e-5d57-46ff-808e-392394f30c8d"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:15.804341 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d8d1cc55-55d0-4bc3-b896-f593891bc34b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:15.810472 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc55-55d0-4bc3-b896-f593891bc34b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:15.810919 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc55-55d0-4bc3-b896-f593891bc34b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:15.811670 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc55-55d0-4bc3-b896-f593891bc34b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:15.812101 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d8d1cc55-55d0-4bc3-b896-f593891bc34b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:15.887012 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5e92750c-4955-44a1-9fda-a1539060b4dd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:15.896856 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5e92750c-4955-44a1-9fda-a1539060b4dd tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.164948 Jun 23 22:52:15.897427 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 440/898] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:15 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:16.482751 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d8d1cc55-55d0-4bc3-b896-f593891bc34b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "POST /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683368 Jun 23 22:52:16.483363 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 459/899] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:52:15 2022] POST /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:52:16.914378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5cc22d8b-b7a8-444f-92b0-a751caccd1ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:16.914908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5cc22d8b-b7a8-444f-92b0-a751caccd1ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:16.921563 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cc22d8b-b7a8-444f-92b0-a751caccd1ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:16.922019 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cc22d8b-b7a8-444f-92b0-a751caccd1ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:16.922778 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cc22d8b-b7a8-444f-92b0-a751caccd1ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:16.923218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5cc22d8b-b7a8-444f-92b0-a751caccd1ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:17.063559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5cc22d8b-b7a8-444f-92b0-a751caccd1ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:17.072467 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5cc22d8b-b7a8-444f-92b0-a751caccd1ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.161974 Jun 23 22:52:17.073071 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 441/900] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:16 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:18.090691 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-de4bfa2b-0fdb-41e0-833f-5b9cf4d5ec63 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:18.091558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-de4bfa2b-0fdb-41e0-833f-5b9cf4d5ec63 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:18.098699 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de4bfa2b-0fdb-41e0-833f-5b9cf4d5ec63 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:18.099151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de4bfa2b-0fdb-41e0-833f-5b9cf4d5ec63 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:18.099912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de4bfa2b-0fdb-41e0-833f-5b9cf4d5ec63 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:18.100349 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de4bfa2b-0fdb-41e0-833f-5b9cf4d5ec63 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:18.481219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-de4bfa2b-0fdb-41e0-833f-5b9cf4d5ec63 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:18.490185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-de4bfa2b-0fdb-41e0-833f-5b9cf4d5ec63 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.403774 Jun 23 22:52:18.490762 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 460/901] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:18 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:19.507387 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3d122016-7572-4ff7-87a6-2fa594e410d8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:19.507992 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3d122016-7572-4ff7-87a6-2fa594e410d8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:19.510298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=42 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:19.515090 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d122016-7572-4ff7-87a6-2fa594e410d8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:19.518684 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d122016-7572-4ff7-87a6-2fa594e410d8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:19.518684 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d122016-7572-4ff7-87a6-2fa594e410d8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:19.518684 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d122016-7572-4ff7-87a6-2fa594e410d8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:19.659776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3d122016-7572-4ff7-87a6-2fa594e410d8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:19.667813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3d122016-7572-4ff7-87a6-2fa594e410d8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1757 microversion: 2.1 time: 0.164323 Jun 23 22:52:19.668462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 442/902] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:19 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:20.685778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-33b30c3d-95d5-4f76-a522-e540bdeeca78 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:20.686339 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-33b30c3d-95d5-4f76-a522-e540bdeeca78 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:20.693381 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-33b30c3d-95d5-4f76-a522-e540bdeeca78 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:20.693831 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-33b30c3d-95d5-4f76-a522-e540bdeeca78 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:20.694620 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-33b30c3d-95d5-4f76-a522-e540bdeeca78 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:20.695059 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-33b30c3d-95d5-4f76-a522-e540bdeeca78 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:20.834837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-33b30c3d-95d5-4f76-a522-e540bdeeca78 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:20.842655 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-33b30c3d-95d5-4f76-a522-e540bdeeca78 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1760 microversion: 2.1 time: 0.160866 Jun 23 22:52:20.843204 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 461/903] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:20 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:21.225319 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-179eeecf-a0c9-4cd2-b5ff-cbec8b347f7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:21.225892 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-179eeecf-a0c9-4cd2-b5ff-cbec8b347f7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:21.232789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-179eeecf-a0c9-4cd2-b5ff-cbec8b347f7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:21.233243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-179eeecf-a0c9-4cd2-b5ff-cbec8b347f7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:21.234000 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-179eeecf-a0c9-4cd2-b5ff-cbec8b347f7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:21.234436 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-179eeecf-a0c9-4cd2-b5ff-cbec8b347f7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:21.257672 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-179eeecf-a0c9-4cd2-b5ff-cbec8b347f7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/ips" status: 200 len: 146 microversion: 2.1 time: 0.037043 Jun 23 22:52:21.260562 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 443/904] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:52:21 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:52:26.185619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c624d8d1-7986-44f6-a996-4057bbcd2bd2 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:26.190244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c624d8d1-7986-44f6-a996-4057bbcd2bd2 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:26.190244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=42 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:26.194350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c624d8d1-7986-44f6-a996-4057bbcd2bd2 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:26.194809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c624d8d1-7986-44f6-a996-4057bbcd2bd2 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:26.196214 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c624d8d1-7986-44f6-a996-4057bbcd2bd2 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:26.196688 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c624d8d1-7986-44f6-a996-4057bbcd2bd2 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:26.280885 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-c624d8d1-7986-44f6-a996-4057bbcd2bd2 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lazy-loading 'services' on Instance uuid 4088ae49-8ab6-4972-aab8-b031ca199296 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:52:26.489461 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c624d8d1-7986-44f6-a996-4057bbcd2bd2 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments/29447b4e-5d57-46ff-808e-392394f30c8d" status: 202 len: 0 microversion: 2.1 time: 0.307876 Jun 23 22:52:26.490055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 462/905] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:52:26 2022] DELETE /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments/29447b4e-5d57-46ff-808e-392394f30c8d => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:52:26.499298 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-29ffd10b-fde2-41e3-b8e4-c4966e02b7b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:26.500215 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-29ffd10b-fde2-41e3-b8e4-c4966e02b7b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:26.507518 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29ffd10b-fde2-41e3-b8e4-c4966e02b7b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:26.507953 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29ffd10b-fde2-41e3-b8e4-c4966e02b7b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:26.508745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29ffd10b-fde2-41e3-b8e4-c4966e02b7b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:26.509183 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-29ffd10b-fde2-41e3-b8e4-c4966e02b7b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:26.538114 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-29ffd10b-fde2-41e3-b8e4-c4966e02b7b8 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043564 Jun 23 22:52:26.538660 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 444/906] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:52:26 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:52:26.985849 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7cdbefdc-6c15-471e-a30f-378b324ba7e3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91cd2895-1168-4efe-bb9e-65c0e474ee8a"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:26.987104 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7cdbefdc-6c15-471e-a30f-378b324ba7e3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:26.993903 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7cdbefdc-6c15-471e-a30f-378b324ba7e3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:26.994362 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7cdbefdc-6c15-471e-a30f-378b324ba7e3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:26.995134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7cdbefdc-6c15-471e-a30f-378b324ba7e3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:26.995578 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7cdbefdc-6c15-471e-a30f-378b324ba7e3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:27.012707 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:27.551068 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-197b09ce-6da6-4e29-81e7-b273aafa0595 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:27.552158 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-197b09ce-6da6-4e29-81e7-b273aafa0595 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:27.559204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-197b09ce-6da6-4e29-81e7-b273aafa0595 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:27.559596 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-197b09ce-6da6-4e29-81e7-b273aafa0595 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:27.560363 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-197b09ce-6da6-4e29-81e7-b273aafa0595 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:27.560832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-197b09ce-6da6-4e29-81e7-b273aafa0595 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:27.595535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-197b09ce-6da6-4e29-81e7-b273aafa0595 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048974 Jun 23 22:52:27.595535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 445/907] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:52:27 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:52:28.019156 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7cdbefdc-6c15-471e-a30f-378b324ba7e3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.037576 Jun 23 22:52:28.019901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 463/908] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:52:26 2022] POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/os-volume_attachments => generated 194 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:52:28.606891 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fd6748d6-8332-426b-b804-322f1508ed33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:28.607749 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fd6748d6-8332-426b-b804-322f1508ed33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:28.614785 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd6748d6-8332-426b-b804-322f1508ed33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:28.615235 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd6748d6-8332-426b-b804-322f1508ed33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:28.616023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd6748d6-8332-426b-b804-322f1508ed33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:28.616459 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fd6748d6-8332-426b-b804-322f1508ed33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:28.645561 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fd6748d6-8332-426b-b804-322f1508ed33 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042961 Jun 23 22:52:28.646124 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 446/909] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:52:28 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:52:28.725599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4143c4d6-ae63-4d22-9554-ce5028dcfac9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:28.726186 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4143c4d6-ae63-4d22-9554-ce5028dcfac9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:28.732640 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4143c4d6-ae63-4d22-9554-ce5028dcfac9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:28.733096 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4143c4d6-ae63-4d22-9554-ce5028dcfac9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:28.733853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4143c4d6-ae63-4d22-9554-ce5028dcfac9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:28.734291 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4143c4d6-ae63-4d22-9554-ce5028dcfac9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:28.758316 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4143c4d6-ae63-4d22-9554-ce5028dcfac9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:52:29.041061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4143c4d6-ae63-4d22-9554-ce5028dcfac9 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 204 len: 0 microversion: 2.1 time: 0.320445 Jun 23 22:52:29.041812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 464/910] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:52:28 2022] DELETE /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:52:29.050184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9daa81fc-6561-4606-9513-c795922b1bad tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:29.050837 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9daa81fc-6561-4606-9513-c795922b1bad tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:29.057125 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9daa81fc-6561-4606-9513-c795922b1bad tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:29.057573 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9daa81fc-6561-4606-9513-c795922b1bad tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:29.058332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9daa81fc-6561-4606-9513-c795922b1bad tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:29.058767 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9daa81fc-6561-4606-9513-c795922b1bad tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:29.187855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9daa81fc-6561-4606-9513-c795922b1bad tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:29.196094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9daa81fc-6561-4606-9513-c795922b1bad tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1680 microversion: 2.1 time: 0.149914 Jun 23 22:52:29.196622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 447/911] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:29 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:30.214220 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-429fa567-e321-4c7c-ae24-9c51909b44ec tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:30.214962 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-429fa567-e321-4c7c-ae24-9c51909b44ec tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:30.222098 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-429fa567-e321-4c7c-ae24-9c51909b44ec tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:30.225477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-429fa567-e321-4c7c-ae24-9c51909b44ec tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:30.225477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-429fa567-e321-4c7c-ae24-9c51909b44ec tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:30.225477 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-429fa567-e321-4c7c-ae24-9c51909b44ec tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:30.358422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-429fa567-e321-4c7c-ae24-9c51909b44ec tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:30.366129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-429fa567-e321-4c7c-ae24-9c51909b44ec tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1680 microversion: 2.1 time: 0.156246 Jun 23 22:52:30.366701 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 465/912] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:30 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:30.869261 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1407712350", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-546473830", "security_groups": [{"name": "tempest-secgroup-smoke-1398705249"}], "block_device_mapping_v2": [{"uuid": "a52171c0-1502-4cb5-a270-c7add30ac5f2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "89376fea-def3-4053-a062-fad013e2e839"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:30.981136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] validate_networks() for [('89376fea-def3-4053-a062-fad013e2e839', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:52:31.383519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c437155b-c86e-43eb-b63e-3763098c3c82 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:31.384170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c437155b-c86e-43eb-b63e-3763098c3c82 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:31.390886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c437155b-c86e-43eb-b63e-3763098c3c82 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:31.391342 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c437155b-c86e-43eb-b63e-3763098c3c82 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:31.392103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c437155b-c86e-43eb-b63e-3763098c3c82 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:31.392542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c437155b-c86e-43eb-b63e-3763098c3c82 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:31.523834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c437155b-c86e-43eb-b63e-3763098c3c82 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:31.531542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c437155b-c86e-43eb-b63e-3763098c3c82 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1680 microversion: 2.1 time: 0.151906 Jun 23 22:52:31.532185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 466/913] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:31 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:31.651351 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:52:31.651792 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:52:31.652438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:52:31.652921 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:52:31.653454 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:52:31.663040 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:31.667213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:31.667213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:31.667213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:31.681808 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Getting quotas for project 6fdc472916934fac985e88fb6a61290b. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:52:31.685778 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Getting quotas for user 84a5fb262284400591cf29dd13771ee7 and project 6fdc472916934fac985e88fb6a61290b. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:52:31.747933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:52:31.747933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a52171c0-1502-4cb5-a270-c7add30ac5f2',volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:52:32.137211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-e6b8e5cc-292c-4661-ace7-189a792da631 req-50eaabb6-82c9-4637-bbd7-445b81b43033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4088ae49-8ab6-4972-aab8-b031ca199296", "name": "network-vif-deleted", "tag": "877ad78a-539d-46ac-b4ef-390cdb390092"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:32.146018 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-e6b8e5cc-292c-4661-ace7-189a792da631 req-50eaabb6-82c9-4637-bbd7-445b81b43033 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:32.146465 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-e6b8e5cc-292c-4661-ace7-189a792da631 req-50eaabb6-82c9-4637-bbd7-445b81b43033 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:32.151217 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1380e55b-8118-4362-af19-c3f360906583 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.285542 Jun 23 22:52:32.152078 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 448/914] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:52:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:52:32.158821 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-e6b8e5cc-292c-4661-ace7-189a792da631 req-50eaabb6-82c9-4637-bbd7-445b81b43033 service nova] Creating event network-vif-deleted:877ad78a-539d-46ac-b4ef-390cdb390092 for instance 4088ae49-8ab6-4972-aab8-b031ca199296 on hv-cinder-81322 Jun 23 22:52:32.163493 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4a982e1a-d99d-4ff5-b67d-2fb8d936d496 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:32.170256 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4a982e1a-d99d-4ff5-b67d-2fb8d936d496 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:32.170765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-e6b8e5cc-292c-4661-ace7-189a792da631 req-50eaabb6-82c9-4637-bbd7-445b81b43033 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032345 Jun 23 22:52:32.170765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 467/915] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:52:32.302746 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4a982e1a-d99d-4ff5-b67d-2fb8d936d496 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:32.322227 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4a982e1a-d99d-4ff5-b67d-2fb8d936d496 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1094 microversion: 2.1 time: 0.163136 Jun 23 22:52:32.327873 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 449/916] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:32 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1094 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:32.551192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:32.551900 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:32.558521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:32.561321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:32.561321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:32.561321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:32.595902 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:32.596965 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:32.597426 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lazy-loading 'fault' on Instance uuid 4088ae49-8ab6-4972-aab8-b031ca199296 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:52:32.639454 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d7e431402f8433fb7565f69103485ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18ed82f19aa2407dac94c2dc67a3fa9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:32.648098 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-19b49a79-64ff-4f8a-a276-c39f86ba41b1 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 200 len: 1331 microversion: 2.1 time: 0.102693 Jun 23 22:52:32.648677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 468/917] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:32 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:33.343148 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-68f85e89-d0a8-4a39-9c98-6ad512639ed4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:33.344287 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-68f85e89-d0a8-4a39-9c98-6ad512639ed4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:33.352897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68f85e89-d0a8-4a39-9c98-6ad512639ed4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:33.353446 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68f85e89-d0a8-4a39-9c98-6ad512639ed4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:33.354330 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68f85e89-d0a8-4a39-9c98-6ad512639ed4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:33.354873 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68f85e89-d0a8-4a39-9c98-6ad512639ed4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:33.422431 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68f85e89-d0a8-4a39-9c98-6ad512639ed4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:33.430784 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-68f85e89-d0a8-4a39-9c98-6ad512639ed4 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1144 microversion: 2.1 time: 0.092655 Jun 23 22:52:33.431342 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 450/918] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:33 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:33.672353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:33.672927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:33.679999 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:33.681872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:33.681872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:33.681872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:33.695100 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 HTTP/1.1 Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:52:33.696770 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:33.698403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '4088ae49-8ab6-4972-aab8-b031ca199296'} Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:33.699424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:33.700853 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:33.702122 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:33.702122 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e69eb8e1-edcb-41d7-9b14-d0ffe5a6021b tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 404 len: 111 microversion: 2.1 time: 0.030025 Jun 23 22:52:33.702122 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 469/919] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:33 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:52:33.707103 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c155d809-4068-48dc-9ce3-997f67f9b440 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '.version_select at 0x7fbbca1d5d30>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:33.783802 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c155d809-4068-48dc-9ce3-997f67f9b440 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031554355" status: 202 len: 0 microversion: 2.1 time: 0.080548 Jun 23 22:52:33.784917 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 451/920] 10.222.0.33 () {58 vars in 1220 bytes} [Thu Jun 23 22:52:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031554355 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:52:34.447442 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fc8f6562-0279-415d-bdb7-803eed823285 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:34.448044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fc8f6562-0279-415d-bdb7-803eed823285 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:34.454132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc8f6562-0279-415d-bdb7-803eed823285 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:34.454585 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc8f6562-0279-415d-bdb7-803eed823285 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:34.455353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc8f6562-0279-415d-bdb7-803eed823285 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:34.455884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fc8f6562-0279-415d-bdb7-803eed823285 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:34.558609 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-fc8f6562-0279-415d-bdb7-803eed823285 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:34.567254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fc8f6562-0279-415d-bdb7-803eed823285 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1210 microversion: 2.1 time: 0.123478 Jun 23 22:52:34.567868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 470/921] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:34 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:35.585398 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d304d091-a5c2-43d6-8165-03b991b478dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:35.586005 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d304d091-a5c2-43d6-8165-03b991b478dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:35.592175 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d304d091-a5c2-43d6-8165-03b991b478dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:35.592663 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d304d091-a5c2-43d6-8165-03b991b478dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:35.593484 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d304d091-a5c2-43d6-8165-03b991b478dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:35.593916 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d304d091-a5c2-43d6-8165-03b991b478dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:35.770126 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d304d091-a5c2-43d6-8165-03b991b478dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:35.779532 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d304d091-a5c2-43d6-8165-03b991b478dc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1278 microversion: 2.1 time: 0.198595 Jun 23 22:52:35.780400 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 452/922] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:35 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:35.924065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:35.924564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:35.931561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:35.932015 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:35.932906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:35.933341 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:35.946844 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: DELETE /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 HTTP/1.1 Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:52:35.948376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.950076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '4088ae49-8ab6-4972-aab8-b031ca199296'} Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:35.951016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.952485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.953955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:35.953955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-347934a7-3add-4ecc-8cd8-a8b446a7df5d tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 404 len: 111 microversion: 2.1 time: 0.030060 Jun 23 22:52:35.953955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 471/923] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:52:35 2022] DELETE /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:52:35.961010 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:35.961628 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 4088ae49-8ab6-4972-aab8-b031ca199296] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:35.967868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:35.968315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:35.969108 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:35.969540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:35.984125 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 HTTP/1.1 Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:52:35.985813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.992002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '4088ae49-8ab6-4972-aab8-b031ca199296'} Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:35.992930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. Jun 23 22:52:35.994414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:35.995822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 4088ae49-8ab6-4972-aab8-b031ca199296 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:35.995822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d5a2b0f1-2372-4d14-9978-35a6b1b7d4eb tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296" status: 404 len: 111 microversion: 2.1 time: 0.030285 Jun 23 22:52:35.995822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 453/924] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:35 2022] GET /compute/v2.1/servers/4088ae49-8ab6-4972-aab8-b031ca199296 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:52:36.069793 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-614b5133-2681-4783-8390-de7f9e449030 req-f9433362-17d3-4b29-bd1a-b31b00d2119e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527872f-0d7a-40d9-8580-8b600f9faab0", "tag": "c99bb277-531f-4d18-9249-90e6d9db2e1b"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:36.081432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-614b5133-2681-4783-8390-de7f9e449030 req-f9433362-17d3-4b29-bd1a-b31b00d2119e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:36.081915 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-614b5133-2681-4783-8390-de7f9e449030 req-f9433362-17d3-4b29-bd1a-b31b00d2119e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:36.095635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-614b5133-2681-4783-8390-de7f9e449030 req-f9433362-17d3-4b29-bd1a-b31b00d2119e service nova] Creating event network-changed:c99bb277-531f-4d18-9249-90e6d9db2e1b for instance d527872f-0d7a-40d9-8580-8b600f9faab0 on hv-cinder-81322 Jun 23 22:52:36.103155 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-614b5133-2681-4783-8390-de7f9e449030 req-f9433362-17d3-4b29-bd1a-b31b00d2119e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037318 Jun 23 22:52:36.108708 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 472/925] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:52:36.797584 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b12e2140-a241-4092-96a8-38ebeb6a3737 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:36.798230 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b12e2140-a241-4092-96a8-38ebeb6a3737 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:36.804823 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b12e2140-a241-4092-96a8-38ebeb6a3737 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:36.805271 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b12e2140-a241-4092-96a8-38ebeb6a3737 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:36.806030 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b12e2140-a241-4092-96a8-38ebeb6a3737 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:36.806461 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b12e2140-a241-4092-96a8-38ebeb6a3737 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.017578 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b12e2140-a241-4092-96a8-38ebeb6a3737 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:37.025831 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b12e2140-a241-4092-96a8-38ebeb6a3737 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1278 microversion: 2.1 time: 0.232153 Jun 23 22:52:37.026497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 454/926] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:36 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1278 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:37.300971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:37.301661 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:37.307906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.311881 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.311881 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.311881 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.323347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: DELETE /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 HTTP/1.1 Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:52:37.324976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.326583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '49d70e57-0b2f-40c0-92c9-ff20698a0de0'} Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:37.327429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.328992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.330469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:37.330469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-44aabec5-7675-49ac-9117-934f913185aa tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 404 len: 111 microversion: 2.1 time: 0.030219 Jun 23 22:52:37.330469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 473/927] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:52:37 2022] DELETE /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:52:37.335549 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:37.336160 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 49d70e57-0b2f-40c0-92c9-ff20698a0de0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:37.342082 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.342527 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.343283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.343710 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.357173 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 HTTP/1.1 Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:52:37.358909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.361623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '49d70e57-0b2f-40c0-92c9-ff20698a0de0'} Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:37.362680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. Jun 23 22:52:37.364514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.370857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 49d70e57-0b2f-40c0-92c9-ff20698a0de0 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:37.370857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c577f5ae-ea5b-46e8-8ff1-dff200779690 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0" status: 404 len: 111 microversion: 2.1 time: 0.029321 Jun 23 22:52:37.370857 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 455/928] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:37 2022] GET /compute/v2.1/servers/49d70e57-0b2f-40c0-92c9-ff20698a0de0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:52:37.371118 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:37.371118 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:37.376763 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.377218 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.378503 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.379107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.400856 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: DELETE /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 HTTP/1.1 Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:52:37.402446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.404073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '63c92940-b145-488a-9b8d-8c500cec9f96'} Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:37.405192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.406687 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.408237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:37.408237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a9a80298-9e17-4911-b260-e6b2dacde6c0 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 404 len: 111 microversion: 2.1 time: 0.038964 Jun 23 22:52:37.408237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 474/929] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:52:37 2022] DELETE /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:52:37.412295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:37.419186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: 63c92940-b145-488a-9b8d-8c500cec9f96] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:37.419186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.419412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.420080 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.420508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.434448 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 HTTP/1.1 Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:52:37.436150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.437812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '63c92940-b145-488a-9b8d-8c500cec9f96'} Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:37.438717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. Jun 23 22:52:37.440252 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:37.445257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance 63c92940-b145-488a-9b8d-8c500cec9f96 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:37.445257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fceee3e8-fb7f-49b9-b0a1-35155f27fb00 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96" status: 404 len: 111 microversion: 2.1 time: 0.029404 Jun 23 22:52:37.445257 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 456/930] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:37 2022] GET /compute/v2.1/servers/63c92940-b145-488a-9b8d-8c500cec9f96 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:52:37.684695 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8bace0f0-0db8-43d5-b118-c94b4120288f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:37.691945 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8bace0f0-0db8-43d5-b118-c94b4120288f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:37.692403 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8bace0f0-0db8-43d5-b118-c94b4120288f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:37.905732 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8bace0f0-0db8-43d5-b118-c94b4120288f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Going to try to stop instance {{(pid=124724) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 22:52:38.046955 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3bf098e8-c770-460c-a3c4-3358d403d019 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:38.047707 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3bf098e8-c770-460c-a3c4-3358d403d019 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:38.055111 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bf098e8-c770-460c-a3c4-3358d403d019 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:38.056213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bf098e8-c770-460c-a3c4-3358d403d019 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:38.057031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bf098e8-c770-460c-a3c4-3358d403d019 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:38.057478 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3bf098e8-c770-460c-a3c4-3358d403d019 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:38.088991 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8bace0f0-0db8-43d5-b118-c94b4120288f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/action" status: 202 len: 0 microversion: 2.1 time: 0.409692 Jun 23 22:52:38.089761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 475/931] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:52:37 2022] POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/action => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:52:38.098925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b9389a8e-9a14-42b5-b571-8f86566d5d64 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:38.099646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b9389a8e-9a14-42b5-b571-8f86566d5d64 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:38.106241 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b9389a8e-9a14-42b5-b571-8f86566d5d64 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:38.106897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b9389a8e-9a14-42b5-b571-8f86566d5d64 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:38.107662 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b9389a8e-9a14-42b5-b571-8f86566d5d64 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:38.108126 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b9389a8e-9a14-42b5-b571-8f86566d5d64 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:38.194373 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3bf098e8-c770-460c-a3c4-3358d403d019 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:38.202326 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3bf098e8-c770-460c-a3c4-3358d403d019 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.159372 Jun 23 22:52:38.205480 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 457/932] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:38 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:38.242956 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b9389a8e-9a14-42b5-b571-8f86566d5d64 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:38.252189 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b9389a8e-9a14-42b5-b571-8f86566d5d64 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.158328 Jun 23 22:52:38.252847 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 476/933] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:38 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:38.764226 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:38.764742 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:38.771594 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:38.772037 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:38.772810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:38.773245 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:38.787780 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 HTTP/1.1 Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:52:38.789344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.790957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': 'e8042229-5eb7-4d72-a37f-d3d15dff51b8'} Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:38.791855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.793378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.794817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:38.794817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fa5ac38b-8551-41ae-a044-1e3e0482a052 tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 404 len: 111 microversion: 2.1 time: 0.030309 Jun 23 22:52:38.794817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 458/934] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:52:38 2022] DELETE /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:52:38.798896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:38.799504 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] [instance: e8042229-5eb7-4d72-a37f-d3d15dff51b8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:38.805929 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:38.806374 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:38.807124 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:38.807557 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:38.821078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] HTTP exception thrown: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Request method failure captured: Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 HTTP/1.1 Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO0GdpfnD2g5d8XHRBn3IZFgUDeiK8Z6ckrGhnjh_hqZIrGgraekR26JA43Ypw6IqMMrO-CHDUbcFFUFv7Gjfr8WvkkJGW-QQulh39OK41OY3tpKIZwhcPKdC_V2ihYiintkI875LIZIXzutoaDx-Ui9Dh7LAsnOXf0c8U-z7a1cj5w Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:52:38.822659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_18ed82f19aa2407dac94c2dc67a3fa9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/18ed82f19aa2407dac94c2dc67a3fa9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 18ed82f19aa2407dac94c2dc67a3fa9c Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2058692240 Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 1d7e431402f8433fb7565f69103485ce Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeNegativeTest-2058692240-project Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.824222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': 'e8042229-5eb7-4d72-a37f-d3d15dff51b8'} Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:38.825145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. Jun 23 22:52:38.826584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:38.827898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] Returning 404 to user: Instance e8042229-5eb7-4d72-a37f-d3d15dff51b8 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:38.827898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-29c2cb54-388a-49e4-be48-19a18c8252de tempest-AttachVolumeNegativeTest-2058692240 tempest-AttachVolumeNegativeTest-2058692240-project] 10.222.0.33 "GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8" status: 404 len: 111 microversion: 2.1 time: 0.028862 Jun 23 22:52:38.827898 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 477/935] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:38 2022] GET /compute/v2.1/servers/e8042229-5eb7-4d72-a37f-d3d15dff51b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:52:39.219166 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e92c7972-bf38-49a1-87ed-4d640b724081 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:39.219773 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e92c7972-bf38-49a1-87ed-4d640b724081 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:39.226241 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92c7972-bf38-49a1-87ed-4d640b724081 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:39.226682 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92c7972-bf38-49a1-87ed-4d640b724081 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:39.227453 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92c7972-bf38-49a1-87ed-4d640b724081 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:39.227884 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e92c7972-bf38-49a1-87ed-4d640b724081 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:39.274197 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ed4a4045-3192-40cf-8dc6-fdc93e7063dc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:39.274894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ed4a4045-3192-40cf-8dc6-fdc93e7063dc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:39.281128 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed4a4045-3192-40cf-8dc6-fdc93e7063dc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:39.281700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed4a4045-3192-40cf-8dc6-fdc93e7063dc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:39.282578 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed4a4045-3192-40cf-8dc6-fdc93e7063dc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:39.283283 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed4a4045-3192-40cf-8dc6-fdc93e7063dc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:39.364870 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e92c7972-bf38-49a1-87ed-4d640b724081 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:39.372633 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e92c7972-bf38-49a1-87ed-4d640b724081 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.157278 Jun 23 22:52:39.373194 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 459/936] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:39 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:39.473654 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ed4a4045-3192-40cf-8dc6-fdc93e7063dc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:39.481739 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ed4a4045-3192-40cf-8dc6-fdc93e7063dc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.216043 Jun 23 22:52:39.482296 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 478/937] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:39 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:40.390334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1edd3b8e-c48d-41c8-85ba-f9a4daef59ce tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:40.391041 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1edd3b8e-c48d-41c8-85ba-f9a4daef59ce tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:40.399039 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1edd3b8e-c48d-41c8-85ba-f9a4daef59ce tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:40.399588 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1edd3b8e-c48d-41c8-85ba-f9a4daef59ce tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:40.400441 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1edd3b8e-c48d-41c8-85ba-f9a4daef59ce tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:40.400987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1edd3b8e-c48d-41c8-85ba-f9a4daef59ce tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:40.499488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a9b5b10d-503b-4cde-9df7-9b67333a809c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:40.500901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a9b5b10d-503b-4cde-9df7-9b67333a809c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:40.509061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9b5b10d-503b-4cde-9df7-9b67333a809c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:40.509690 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9b5b10d-503b-4cde-9df7-9b67333a809c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:40.510473 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9b5b10d-503b-4cde-9df7-9b67333a809c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:40.511073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a9b5b10d-503b-4cde-9df7-9b67333a809c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:40.549777 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1edd3b8e-c48d-41c8-85ba-f9a4daef59ce tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:40.553481 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:40.558522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1edd3b8e-c48d-41c8-85ba-f9a4daef59ce tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.171985 Jun 23 22:52:40.559919 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 460/938] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:40 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:40.669627 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a9b5b10d-503b-4cde-9df7-9b67333a809c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:40.678893 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a9b5b10d-503b-4cde-9df7-9b67333a809c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.183474 Jun 23 22:52:40.688206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 479/939] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:40 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:41.575745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-95ffd5ea-f6ea-432d-89d4-e01ee4060981 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:41.576364 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-95ffd5ea-f6ea-432d-89d4-e01ee4060981 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:41.584553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-95ffd5ea-f6ea-432d-89d4-e01ee4060981 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:41.585182 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-95ffd5ea-f6ea-432d-89d4-e01ee4060981 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:41.586042 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-95ffd5ea-f6ea-432d-89d4-e01ee4060981 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:41.586551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-95ffd5ea-f6ea-432d-89d4-e01ee4060981 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:41.673672 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:41.695346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8ae3e034-f020-471d-ba6b-c7e8771d9648 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:41.695960 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8ae3e034-f020-471d-ba6b-c7e8771d9648 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:41.702982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ae3e034-f020-471d-ba6b-c7e8771d9648 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:41.704120 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ae3e034-f020-471d-ba6b-c7e8771d9648 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:41.704949 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ae3e034-f020-471d-ba6b-c7e8771d9648 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:41.705387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8ae3e034-f020-471d-ba6b-c7e8771d9648 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:41.732055 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:41.737204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-95ffd5ea-f6ea-432d-89d4-e01ee4060981 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:41.745213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-95ffd5ea-f6ea-432d-89d4-e01ee4060981 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.173835 Jun 23 22:52:41.751745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 461/940] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:41 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:41.859461 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8ae3e034-f020-471d-ba6b-c7e8771d9648 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:41.868268 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8ae3e034-f020-471d-ba6b-c7e8771d9648 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.176840 Jun 23 22:52:41.869079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 480/941] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:41 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:42.763044 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8d11d083-d4a5-4688-b47e-ce8a7bdaf210 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:42.763737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8d11d083-d4a5-4688-b47e-ce8a7bdaf210 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:42.769920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=8 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:42.774318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d11d083-d4a5-4688-b47e-ce8a7bdaf210 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:42.774836 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d11d083-d4a5-4688-b47e-ce8a7bdaf210 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:42.775609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d11d083-d4a5-4688-b47e-ce8a7bdaf210 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:42.776178 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8d11d083-d4a5-4688-b47e-ce8a7bdaf210 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:42.885837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e798d9c4-bf3d-4487-b825-ad95f5f992a5 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:42.886448 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e798d9c4-bf3d-4487-b825-ad95f5f992a5 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:42.893053 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e798d9c4-bf3d-4487-b825-ad95f5f992a5 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:42.896181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e798d9c4-bf3d-4487-b825-ad95f5f992a5 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:42.896181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e798d9c4-bf3d-4487-b825-ad95f5f992a5 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:42.896181 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e798d9c4-bf3d-4487-b825-ad95f5f992a5 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:42.943519 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8d11d083-d4a5-4688-b47e-ce8a7bdaf210 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:42.951199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8d11d083-d4a5-4688-b47e-ce8a7bdaf210 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.192038 Jun 23 22:52:42.951777 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 462/942] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:42 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:43.086539 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e798d9c4-bf3d-4487-b825-ad95f5f992a5 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:43.094620 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e798d9c4-bf3d-4487-b825-ad95f5f992a5 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.213102 Jun 23 22:52:43.095180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 481/943] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:42 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:43.968604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a1d0b678-3b3c-4036-9262-2e07b32111fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:43.969312 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a1d0b678-3b3c-4036-9262-2e07b32111fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:43.976951 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1d0b678-3b3c-4036-9262-2e07b32111fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:43.977405 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1d0b678-3b3c-4036-9262-2e07b32111fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:43.978177 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1d0b678-3b3c-4036-9262-2e07b32111fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:43.978616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a1d0b678-3b3c-4036-9262-2e07b32111fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:44.111527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-14f264da-f2d4-4faa-b681-206762923ded tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:44.112222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-14f264da-f2d4-4faa-b681-206762923ded tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:44.112629 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a1d0b678-3b3c-4036-9262-2e07b32111fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:44.119648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-14f264da-f2d4-4faa-b681-206762923ded tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:44.120103 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-14f264da-f2d4-4faa-b681-206762923ded tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:44.120958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-14f264da-f2d4-4faa-b681-206762923ded tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:44.121323 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a1d0b678-3b3c-4036-9262-2e07b32111fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.156811 Jun 23 22:52:44.121434 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-14f264da-f2d4-4faa-b681-206762923ded tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:44.122113 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 463/944] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:43 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:44.262510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-14f264da-f2d4-4faa-b681-206762923ded tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:44.271352 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-14f264da-f2d4-4faa-b681-206762923ded tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.163822 Jun 23 22:52:44.281204 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 482/945] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:44 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:45.139332 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-147dedb9-ebc9-4454-ba8d-26d8647eb8b0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:45.139948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-147dedb9-ebc9-4454-ba8d-26d8647eb8b0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:45.147048 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-147dedb9-ebc9-4454-ba8d-26d8647eb8b0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:45.147498 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-147dedb9-ebc9-4454-ba8d-26d8647eb8b0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:45.148255 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-147dedb9-ebc9-4454-ba8d-26d8647eb8b0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:45.148781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-147dedb9-ebc9-4454-ba8d-26d8647eb8b0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:45.288568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-147dedb9-ebc9-4454-ba8d-26d8647eb8b0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:45.290863 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-08b648d8-e617-473c-9091-586d595eae07 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:45.291791 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-08b648d8-e617-473c-9091-586d595eae07 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:45.296631 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-147dedb9-ebc9-4454-ba8d-26d8647eb8b0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.161155 Jun 23 22:52:45.297214 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 464/946] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:45 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:45.297884 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-08b648d8-e617-473c-9091-586d595eae07 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:45.298603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-08b648d8-e617-473c-9091-586d595eae07 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:45.299918 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-08b648d8-e617-473c-9091-586d595eae07 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:45.300357 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-08b648d8-e617-473c-9091-586d595eae07 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:45.426358 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-08b648d8-e617-473c-9091-586d595eae07 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:45.434309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-08b648d8-e617-473c-9091-586d595eae07 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.147463 Jun 23 22:52:45.434861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 483/947] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:45 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:46.314601 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2bd68497-b737-4fdc-9fbd-085c1a0c7884 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:46.315328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2bd68497-b737-4fdc-9fbd-085c1a0c7884 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:46.321976 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2bd68497-b737-4fdc-9fbd-085c1a0c7884 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:46.322411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2bd68497-b737-4fdc-9fbd-085c1a0c7884 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:46.323165 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2bd68497-b737-4fdc-9fbd-085c1a0c7884 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:46.323596 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2bd68497-b737-4fdc-9fbd-085c1a0c7884 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:46.452564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6cb8ebfa-68d9-447a-98c9-581e8a069dd3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:46.453224 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6cb8ebfa-68d9-447a-98c9-581e8a069dd3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:46.459765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6cb8ebfa-68d9-447a-98c9-581e8a069dd3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:46.460211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6cb8ebfa-68d9-447a-98c9-581e8a069dd3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:46.461009 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6cb8ebfa-68d9-447a-98c9-581e8a069dd3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:46.461440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6cb8ebfa-68d9-447a-98c9-581e8a069dd3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:46.478640 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2bd68497-b737-4fdc-9fbd-085c1a0c7884 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:46.486343 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2bd68497-b737-4fdc-9fbd-085c1a0c7884 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.176156 Jun 23 22:52:46.488014 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 465/948] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:46 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:46.591212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6cb8ebfa-68d9-447a-98c9-581e8a069dd3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:46.599681 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6cb8ebfa-68d9-447a-98c9-581e8a069dd3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.150977 Jun 23 22:52:46.600229 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 484/949] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:46 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:47.504088 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f1a70022-c7e3-461d-92ce-547fe9934027 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:47.504726 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f1a70022-c7e3-461d-92ce-547fe9934027 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:47.507428 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b2a61e0e-dfb8-4366-9314-590c96cf61b8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:47.509041 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b2a61e0e-dfb8-4366-9314-590c96cf61b8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:47.511208 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1a70022-c7e3-461d-92ce-547fe9934027 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:47.511645 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1a70022-c7e3-461d-92ce-547fe9934027 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:47.512438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1a70022-c7e3-461d-92ce-547fe9934027 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:47.513048 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1a70022-c7e3-461d-92ce-547fe9934027 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:47.516131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2a61e0e-dfb8-4366-9314-590c96cf61b8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:47.516604 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2a61e0e-dfb8-4366-9314-590c96cf61b8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:47.517373 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2a61e0e-dfb8-4366-9314-590c96cf61b8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:47.517819 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b2a61e0e-dfb8-4366-9314-590c96cf61b8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:47.567783 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b2a61e0e-dfb8-4366-9314-590c96cf61b8 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064096 Jun 23 22:52:47.568266 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 485/950] 10.222.0.33 () {60 vars in 1342 bytes} [Thu Jun 23 22:52:47 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:47.618208 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4910bc90-e66a-42d1-8d7d-ea78d0aa0c94 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:47.618407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4910bc90-e66a-42d1-8d7d-ea78d0aa0c94 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:47.624614 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4910bc90-e66a-42d1-8d7d-ea78d0aa0c94 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:47.625076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4910bc90-e66a-42d1-8d7d-ea78d0aa0c94 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:47.625900 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4910bc90-e66a-42d1-8d7d-ea78d0aa0c94 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:47.626340 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4910bc90-e66a-42d1-8d7d-ea78d0aa0c94 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:47.652341 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f1a70022-c7e3-461d-92ce-547fe9934027 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:47.660492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f1a70022-c7e3-461d-92ce-547fe9934027 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.161211 Jun 23 22:52:47.661089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 466/951] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:47 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:47.665846 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ac5c838b-4cc6-4bef-be63-3b7e4f67d796 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:47.666543 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ac5c838b-4cc6-4bef-be63-3b7e4f67d796 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:47.672676 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac5c838b-4cc6-4bef-be63-3b7e4f67d796 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:47.674743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac5c838b-4cc6-4bef-be63-3b7e4f67d796 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:47.674743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac5c838b-4cc6-4bef-be63-3b7e4f67d796 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:47.675154 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ac5c838b-4cc6-4bef-be63-3b7e4f67d796 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:47.701434 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ac5c838b-4cc6-4bef-be63-3b7e4f67d796 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:52:47.757892 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4910bc90-e66a-42d1-8d7d-ea78d0aa0c94 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:47.765907 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4910bc90-e66a-42d1-8d7d-ea78d0aa0c94 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.152135 Jun 23 22:52:47.766459 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 486/952] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:47 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:48.017174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ac5c838b-4cc6-4bef-be63-3b7e4f67d796 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 204 len: 0 microversion: 2.20 time: 0.354576 Jun 23 22:52:48.018052 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 467/953] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 23 22:52:47 2022] DELETE /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 22:52:48.026232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:48.026837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:48.032827 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:48.033275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:48.034616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:48.035056 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:48.171182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:48.179051 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:48.180531 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:48.181704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-79456533-d563-46e4-b390-b09f3f9e3311 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.159414 Jun 23 22:52:48.182256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 487/954] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:48 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:52:48.677797 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-afa72472-ab1f-4646-b0cb-3c59a2ad9119 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:48.678504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-afa72472-ab1f-4646-b0cb-3c59a2ad9119 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:48.685052 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-afa72472-ab1f-4646-b0cb-3c59a2ad9119 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:48.685502 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-afa72472-ab1f-4646-b0cb-3c59a2ad9119 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:48.686380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-afa72472-ab1f-4646-b0cb-3c59a2ad9119 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:48.686817 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-afa72472-ab1f-4646-b0cb-3c59a2ad9119 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:48.783276 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0edd1a17-2cc7-4a27-8431-ca8375938472 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:48.784843 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0edd1a17-2cc7-4a27-8431-ca8375938472 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:48.791119 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0edd1a17-2cc7-4a27-8431-ca8375938472 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:48.791567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0edd1a17-2cc7-4a27-8431-ca8375938472 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:48.792327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0edd1a17-2cc7-4a27-8431-ca8375938472 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:48.793023 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0edd1a17-2cc7-4a27-8431-ca8375938472 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:48.827044 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-afa72472-ab1f-4646-b0cb-3c59a2ad9119 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:48.838995 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-afa72472-ab1f-4646-b0cb-3c59a2ad9119 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.165987 Jun 23 22:52:48.841109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 468/955] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:48 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:48.866114 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-4603ede3-e10f-4b5e-bba4-0776c7e05f0e req-31c6da03-4000-44ee-a182-bf9c0580d46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527872f-0d7a-40d9-8580-8b600f9faab0", "name": "network-vif-plugged", "status": "completed", "tag": "c99bb277-531f-4d18-9249-90e6d9db2e1b"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:48.874781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4603ede3-e10f-4b5e-bba4-0776c7e05f0e req-31c6da03-4000-44ee-a182-bf9c0580d46d service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:48.875230 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4603ede3-e10f-4b5e-bba4-0776c7e05f0e req-31c6da03-4000-44ee-a182-bf9c0580d46d service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:48.887007 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-4603ede3-e10f-4b5e-bba4-0776c7e05f0e req-31c6da03-4000-44ee-a182-bf9c0580d46d service nova] Creating event network-vif-plugged:c99bb277-531f-4d18-9249-90e6d9db2e1b for instance d527872f-0d7a-40d9-8580-8b600f9faab0 on hv-cinder-81322 Jun 23 22:52:48.892018 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-4603ede3-e10f-4b5e-bba4-0776c7e05f0e req-31c6da03-4000-44ee-a182-bf9c0580d46d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031470 Jun 23 22:52:48.894822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 469/956] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:52:48.951881 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-0edd1a17-2cc7-4a27-8431-ca8375938472 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:48.961359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0edd1a17-2cc7-4a27-8431-ca8375938472 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1724 microversion: 2.1 time: 0.181802 Jun 23 22:52:48.962313 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 488/957] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:48 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:49.200938 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:49.201631 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:49.208475 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:49.208945 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:49.209700 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:49.210163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:49.345239 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:49.357748 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:49.359260 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:49.360424 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3e91dddd-d7cf-4d16-b3db-a0a2afa538e9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.164229 Jun 23 22:52:49.361365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 470/958] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:49 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:52:49.859279 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4fb98e9d-7c2a-4eb2-aed3-2c90488a7107 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:49.860350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4fb98e9d-7c2a-4eb2-aed3-2c90488a7107 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:49.867294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4fb98e9d-7c2a-4eb2-aed3-2c90488a7107 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:49.867744 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4fb98e9d-7c2a-4eb2-aed3-2c90488a7107 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:49.868512 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4fb98e9d-7c2a-4eb2-aed3-2c90488a7107 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:49.868975 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4fb98e9d-7c2a-4eb2-aed3-2c90488a7107 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:49.979481 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f1519237-f53b-4138-8e0c-790090970488 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:49.980171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f1519237-f53b-4138-8e0c-790090970488 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:49.983183 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:49.988697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1519237-f53b-4138-8e0c-790090970488 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:49.989275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1519237-f53b-4138-8e0c-790090970488 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:49.990184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1519237-f53b-4138-8e0c-790090970488 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:49.990848 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f1519237-f53b-4138-8e0c-790090970488 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:50.010951 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4fb98e9d-7c2a-4eb2-aed3-2c90488a7107 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:50.019685 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4fb98e9d-7c2a-4eb2-aed3-2c90488a7107 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.164758 Jun 23 22:52:50.020524 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 489/959] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:49 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:50.246476 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f1519237-f53b-4138-8e0c-790090970488 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:50.255164 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f1519237-f53b-4138-8e0c-790090970488 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1701 microversion: 2.1 time: 0.279676 Jun 23 22:52:50.255736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 471/960] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:49 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1701 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:52:50.273054 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5f2f056a-fea2-4c11-b003-fca568684ed7 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:50.279329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5f2f056a-fea2-4c11-b003-fca568684ed7 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:50.279857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5f2f056a-fea2-4c11-b003-fca568684ed7 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:50.309260 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5f2f056a-fea2-4c11-b003-fca568684ed7 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Going to try to start instance {{(pid=124724) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 22:52:50.379150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:50.379789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:50.386501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:50.387131 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:50.391352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:50.391352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:50.500521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5f2f056a-fea2-4c11-b003-fca568684ed7 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/action" status: 202 len: 0 microversion: 2.1 time: 0.231874 Jun 23 22:52:50.501559 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 490/961] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:52:50 2022] POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:52:50.511440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6eef52a9-82fd-40c3-b714-3e4ec3208133 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:50.512222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6eef52a9-82fd-40c3-b714-3e4ec3208133 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:50.521083 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6eef52a9-82fd-40c3-b714-3e4ec3208133 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:50.521538 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6eef52a9-82fd-40c3-b714-3e4ec3208133 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:50.522304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6eef52a9-82fd-40c3-b714-3e4ec3208133 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:50.522743 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6eef52a9-82fd-40c3-b714-3e4ec3208133 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:50.545387 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:50.553890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:50.555467 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:50.556808 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e984722c-3dae-4d81-86f9-633dced53ec9 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1722 microversion: 2.20 time: 0.182107 Jun 23 22:52:50.557437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 472/962] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:50 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 22:52:50.667868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6eef52a9-82fd-40c3-b714-3e4ec3208133 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:50.676321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6eef52a9-82fd-40c3-b714-3e4ec3208133 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1710 microversion: 2.1 time: 0.170208 Jun 23 22:52:50.686220 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 491/963] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:50 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:50.849220 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-4fbef37f-1c5c-4486-842f-8b6d98c6006a req-ff5b533d-badf-46f1-b1da-9afe903ec981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b650e20d-eaa7-4c0c-a6c1-972b92705862", "name": "network-vif-deleted", "tag": "03231fbd-1795-4f15-8223-fd8df18479b9"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:50.864094 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4fbef37f-1c5c-4486-842f-8b6d98c6006a req-ff5b533d-badf-46f1-b1da-9afe903ec981 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:50.864714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-4fbef37f-1c5c-4486-842f-8b6d98c6006a req-ff5b533d-badf-46f1-b1da-9afe903ec981 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:50.877677 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-4fbef37f-1c5c-4486-842f-8b6d98c6006a req-ff5b533d-badf-46f1-b1da-9afe903ec981 service nova] Creating event network-vif-deleted:03231fbd-1795-4f15-8223-fd8df18479b9 for instance b650e20d-eaa7-4c0c-a6c1-972b92705862 on hv-cinder-81322 Jun 23 22:52:50.882903 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-4fbef37f-1c5c-4486-842f-8b6d98c6006a req-ff5b533d-badf-46f1-b1da-9afe903ec981 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039014 Jun 23 22:52:50.883945 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 473/964] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:52:51.038861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-663f769b-c678-4a40-bd79-47059f7615d7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:51.040078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-663f769b-c678-4a40-bd79-47059f7615d7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:51.049558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-663f769b-c678-4a40-bd79-47059f7615d7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:51.052557 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-663f769b-c678-4a40-bd79-47059f7615d7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:51.053734 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-663f769b-c678-4a40-bd79-47059f7615d7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:51.054335 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-663f769b-c678-4a40-bd79-47059f7615d7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:51.233222 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-663f769b-c678-4a40-bd79-47059f7615d7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:51.243375 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-663f769b-c678-4a40-bd79-47059f7615d7 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1266 microversion: 2.1 time: 0.209764 Jun 23 22:52:51.244404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 492/965] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:51 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:51.577768 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:51.579122 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:51.586800 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:51.587565 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:51.588336 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:51.588804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:51.622093 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:51.622576 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:51.623027 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lazy-loading 'fault' on Instance uuid b650e20d-eaa7-4c0c-a6c1-972b92705862 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:52:51.667594 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:51.676274 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:51.678037 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5107e87ee4c34ef9ac96fa4a3a899bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b00f92bcc449daadba8838f4c87a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:51.679217 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9105448b-ce8c-449c-b052-9760eddb071f tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 200 len: 1371 microversion: 2.20 time: 0.106528 Jun 23 22:52:51.680101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 474/966] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:51 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 1371 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 22:52:51.694545 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e03a0dfa-6623-4a2a-8b9c-7b4fbca3024a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:51.695264 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e03a0dfa-6623-4a2a-8b9c-7b4fbca3024a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:51.701591 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e03a0dfa-6623-4a2a-8b9c-7b4fbca3024a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:51.702123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e03a0dfa-6623-4a2a-8b9c-7b4fbca3024a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:51.702969 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e03a0dfa-6623-4a2a-8b9c-7b4fbca3024a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:51.703472 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e03a0dfa-6623-4a2a-8b9c-7b4fbca3024a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:51.845298 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e03a0dfa-6623-4a2a-8b9c-7b4fbca3024a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:51.860627 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e03a0dfa-6623-4a2a-8b9c-7b4fbca3024a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1710 microversion: 2.1 time: 0.170634 Jun 23 22:52:51.862290 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 493/967] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:51 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:52.261181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2f5d09a4-09fa-4884-af61-91f14bbd1eed tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:52.262124 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2f5d09a4-09fa-4884-af61-91f14bbd1eed tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:52.282704 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f5d09a4-09fa-4884-af61-91f14bbd1eed tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:52.284294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f5d09a4-09fa-4884-af61-91f14bbd1eed tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:52.285232 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f5d09a4-09fa-4884-af61-91f14bbd1eed tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:52.285779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2f5d09a4-09fa-4884-af61-91f14bbd1eed tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:52.446954 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2f5d09a4-09fa-4884-af61-91f14bbd1eed tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:52.454745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2f5d09a4-09fa-4884-af61-91f14bbd1eed tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1453 microversion: 2.1 time: 0.198065 Jun 23 22:52:52.455889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 475/968] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:52 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:52.473079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5f5d1e31-57fb-42e7-8c59-041cd9f2ffc0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:52.473683 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5f5d1e31-57fb-42e7-8c59-041cd9f2ffc0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:52.480030 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5f5d1e31-57fb-42e7-8c59-041cd9f2ffc0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:52.480810 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5f5d1e31-57fb-42e7-8c59-041cd9f2ffc0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:52.481561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5f5d1e31-57fb-42e7-8c59-041cd9f2ffc0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:52.481992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5f5d1e31-57fb-42e7-8c59-041cd9f2ffc0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:52.625542 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5f5d1e31-57fb-42e7-8c59-041cd9f2ffc0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:52.634657 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5f5d1e31-57fb-42e7-8c59-041cd9f2ffc0 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1453 microversion: 2.1 time: 0.165305 Jun 23 22:52:52.635288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 494/969] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:52 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:52.699191 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:52.699986 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:52.708605 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:52.708905 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:52.709844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:52.711140 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:52.727182 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] HTTP exception thrown: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Request method failure captured: Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 HTTP/1.1 Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz7G8dX9Rg5ZaZ2hz-_kwX-6RFH2YraqKEhNp9P3mPgW4-LHDWKo_WERUB4sUdoWFRg3ah1uyEIDxOs3fxQ1bn7aCFjUx1ptXBwzmJgEvgTG1J6OSQT8UhqE3KlgAIcnEBrZrrqPwM6L5TX_TUbf4I5vKTJNIIQCZRDD8gr6YNyqAc Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:52:52.728876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_13b00f92bcc449daadba8838f4c87a62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 5107e87ee4c34ef9ac96fa4a3a899bda Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:52.730582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': 'b650e20d-eaa7-4c0c-a6c1-972b92705862'} Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:52.731369 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:52.733593 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:52.735864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Returning 404 to user: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:52.735864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c10e05db-bd7c-483b-94ee-dc07268494ea tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 404 len: 111 microversion: 2.20 time: 0.035833 Jun 23 22:52:52.735864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 476/970] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:52 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:52:52.741170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a3c24f8c-b14c-4682-b509-7cc9c2b8ed48 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '.version_select at 0x7fbbca39aa60>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:52.841787 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a3c24f8c-b14c-4682-b509-7cc9c2b8ed48 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127631303" status: 204 len: 0 microversion: 2.20 time: 0.105712 Jun 23 22:52:52.842361 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 495/971] 10.222.0.33 () {60 vars in 1261 bytes} [Thu Jun 23 22:52:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2127631303 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 22:52:52.879939 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-246a82f4-c83d-4de0-b0f8-fc0019125936 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:52.880558 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-246a82f4-c83d-4de0-b0f8-fc0019125936 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:52.886788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-246a82f4-c83d-4de0-b0f8-fc0019125936 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:52.887233 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-246a82f4-c83d-4de0-b0f8-fc0019125936 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:52.888008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-246a82f4-c83d-4de0-b0f8-fc0019125936 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:52.888447 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-246a82f4-c83d-4de0-b0f8-fc0019125936 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:52.907159 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:53.116233 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-246a82f4-c83d-4de0-b0f8-fc0019125936 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:53.125580 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-246a82f4-c83d-4de0-b0f8-fc0019125936 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1710 microversion: 2.1 time: 0.250310 Jun 23 22:52:53.126272 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 477/972] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:52 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1710 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:54.143664 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a333e97b-92c8-4929-867b-0b16a2c0c03e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:54.144266 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a333e97b-92c8-4929-867b-0b16a2c0c03e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:54.151728 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a333e97b-92c8-4929-867b-0b16a2c0c03e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:54.152144 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a333e97b-92c8-4929-867b-0b16a2c0c03e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:54.152941 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a333e97b-92c8-4929-867b-0b16a2c0c03e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:54.153503 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a333e97b-92c8-4929-867b-0b16a2c0c03e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:54.300983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a333e97b-92c8-4929-867b-0b16a2c0c03e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:52:54.313445 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a333e97b-92c8-4929-867b-0b16a2c0c03e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1714 microversion: 2.1 time: 0.174750 Jun 23 22:52:54.325240 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 496/973] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:52:54 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:52:54.975761 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:54.984199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:54.988619 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:54.989136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:54.989970 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:54.990473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:55.005476 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] HTTP exception thrown: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Request method failure captured: Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 HTTP/1.1 Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz7G8dX9Rg5ZaZ2hz-_kwX-6RFH2YraqKEhNp9P3mPgW4-LHDWKo_WERUB4sUdoWFRg3ah1uyEIDxOs3fxQ1bn7aCFjUx1ptXBwzmJgEvgTG1J6OSQT8UhqE3KlgAIcnEBrZrrqPwM6L5TX_TUbf4I5vKTJNIIQCZRDD8gr6YNyqAc Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:52:55.008501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_13b00f92bcc449daadba8838f4c87a62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 5107e87ee4c34ef9ac96fa4a3a899bda Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.010243 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': 'b650e20d-eaa7-4c0c-a6c1-972b92705862'} Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:55.013315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.014508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.015831 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Returning 404 to user: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:55.015831 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8dd86bda-d734-4554-ab91-df495f022575 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 404 len: 111 microversion: 2.20 time: 0.038095 Jun 23 22:52:55.015831 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 478/974] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 23 22:52:54 2022] DELETE /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:52:55.020247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:55.020970 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: b650e20d-eaa7-4c0c-a6c1-972b92705862] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:55.028657 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:55.029871 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:55.030023 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:55.030671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:55.031962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-729841de-a6c8-4d22-af09-9c6b71c03b91 req-3128572f-d927-463c-afca-0730a20be796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527872f-0d7a-40d9-8580-8b600f9faab0", "tag": "c99bb277-531f-4d18-9249-90e6d9db2e1b"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:52:55.040926 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-729841de-a6c8-4d22-af09-9c6b71c03b91 req-3128572f-d927-463c-afca-0730a20be796 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:55.041456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-729841de-a6c8-4d22-af09-9c6b71c03b91 req-3128572f-d927-463c-afca-0730a20be796 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:55.052747 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:55.058557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-729841de-a6c8-4d22-af09-9c6b71c03b91 req-3128572f-d927-463c-afca-0730a20be796 service nova] Creating event network-changed:c99bb277-531f-4d18-9249-90e6d9db2e1b for instance d527872f-0d7a-40d9-8580-8b600f9faab0 on hv-cinder-81322 Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] HTTP exception thrown: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Request method failure captured: Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 HTTP/1.1 Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitOz7G8dX9Rg5ZaZ2hz-_kwX-6RFH2YraqKEhNp9P3mPgW4-LHDWKo_WERUB4sUdoWFRg3ah1uyEIDxOs3fxQ1bn7aCFjUx1ptXBwzmJgEvgTG1J6OSQT8UhqE3KlgAIcnEBrZrrqPwM6L5TX_TUbf4I5vKTJNIIQCZRDD8gr6YNyqAc Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:52:55.058704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_13b00f92bcc449daadba8838f4c87a62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 5107e87ee4c34ef9ac96fa4a3a899bda Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.060164 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': 'b650e20d-eaa7-4c0c-a6c1-972b92705862'} Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:55.060927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. Jun 23 22:52:55.065886 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:55.068232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Returning 404 to user: Instance b650e20d-eaa7-4c0c-a6c1-972b92705862 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:55.068232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-21be025c-50ee-46df-adc6-de597ecafea3 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862" status: 404 len: 111 microversion: 2.20 time: 0.044060 Jun 23 22:52:55.068232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 497/975] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:55 2022] GET /compute/v2.1/servers/b650e20d-eaa7-4c0c-a6c1-972b92705862 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:52:55.068695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-729841de-a6c8-4d22-af09-9c6b71c03b91 req-3128572f-d927-463c-afca-0730a20be796 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036245 Jun 23 22:52:55.068695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 479/976] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:52:56.362032 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:56.362642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:56.364820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:52:56.370375 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:56.370375 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:56.371177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:56.371612 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:56.385808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] HTTP exception thrown: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Request method failure captured: Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: DELETE /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 HTTP/1.1 Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitOz7G8dX9Rg5ZaZ2hz-_kwX-6RFH2YraqKEhNp9P3mPgW4-LHDWKo_WERUB4sUdoWFRg3ah1uyEIDxOs3fxQ1bn7aCFjUx1ptXBwzmJgEvgTG1J6OSQT8UhqE3KlgAIcnEBrZrrqPwM6L5TX_TUbf4I5vKTJNIIQCZRDD8gr6YNyqAc Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:52:56.387344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_13b00f92bcc449daadba8838f4c87a62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 5107e87ee4c34ef9ac96fa4a3a899bda Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.389095 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '286fefab-3729-4c09-a3be-0af864c6de65'} Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:56.389992 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.391458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.396857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Returning 404 to user: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:56.396857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f4c6ffa5-0dc4-45dd-b717-6feba11aefe6 tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "DELETE /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 404 len: 111 microversion: 2.20 time: 0.031632 Jun 23 22:52:56.396857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 498/977] 10.222.0.33 () {60 vars in 1279 bytes} [Thu Jun 23 22:52:56 2022] DELETE /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 22:52:56.398962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:52:56.399664 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] [instance: 286fefab-3729-4c09-a3be-0af864c6de65] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:52:56.405963 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:56.406411 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:56.407153 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:52:56.407586 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:52:56.422558 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] HTTP exception thrown: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Request method failure captured: Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 HTTP/1.1 Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitOz7G8dX9Rg5ZaZ2hz-_kwX-6RFH2YraqKEhNp9P3mPgW4-LHDWKo_WERUB4sUdoWFRg3ah1uyEIDxOs3fxQ1bn7aCFjUx1ptXBwzmJgEvgTG1J6OSQT8UhqE3KlgAIcnEBrZrrqPwM6L5TX_TUbf4I5vKTJNIIQCZRDD8gr6YNyqAc Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:52:56.424962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_13b00f92bcc449daadba8838f4c87a62", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/13b00f92bcc449daadba8838f4c87a62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 13b00f92bcc449daadba8838f4c87a62 Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-941895722 Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 5107e87ee4c34ef9ac96fa4a3a899bda Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeShelveTestJSON-941895722-project Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.426635 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '286fefab-3729-4c09-a3be-0af864c6de65'} Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:52:56.427489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. Jun 23 22:52:56.428948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:52:56.430275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] Returning 404 to user: Instance 286fefab-3729-4c09-a3be-0af864c6de65 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:52:56.430275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6b016a5b-6d88-4108-a62c-f979cec9bbfc tempest-AttachVolumeShelveTestJSON-941895722 tempest-AttachVolumeShelveTestJSON-941895722-project] 10.222.0.33 "GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65" status: 404 len: 111 microversion: 2.20 time: 0.032693 Jun 23 22:52:56.430275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 480/978] 10.222.0.33 () {60 vars in 1276 bytes} [Thu Jun 23 22:52:56 2022] GET /compute/v2.1/servers/286fefab-3729-4c09-a3be-0af864c6de65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 22:53:00.801698 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-711e1b3b-7204-4207-8f77-175b5e28a241 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1176381209"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:00.802346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-711e1b3b-7204-4207-8f77-175b5e28a241 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:00.810274 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-711e1b3b-7204-4207-8f77-175b5e28a241 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:00.810916 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-711e1b3b-7204-4207-8f77-175b5e28a241 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:00.812134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-711e1b3b-7204-4207-8f77-175b5e28a241 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:00.812605 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-711e1b3b-7204-4207-8f77-175b5e28a241 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:00.944407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.network.security_group_api [None req-711e1b3b-7204-4207-8f77-175b5e28a241 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Removing security group 0865a86d-87e9-4784-8833-96ed41b3639d from port b455f4c7-2530-4f19-81ce-74ad3ad051a8 Jun 23 22:53:01.386108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-711e1b3b-7204-4207-8f77-175b5e28a241 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "POST /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/action" status: 202 len: 0 microversion: 2.1 time: 0.588913 Jun 23 22:53:01.389556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 499/979] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:53:00 2022] POST /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:53:01.418845 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-cefed812-e795-4c27-bdba-070e88362e38 req-4164a637-c876-4814-a4bf-ab523c228f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8836b61b-1200-4e32-825c-c6365bded08f", "tag": "b455f4c7-2530-4f19-81ce-74ad3ad051a8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:01.431292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-cefed812-e795-4c27-bdba-070e88362e38 req-4164a637-c876-4814-a4bf-ab523c228f4b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:01.434664 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-cefed812-e795-4c27-bdba-070e88362e38 req-4164a637-c876-4814-a4bf-ab523c228f4b service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:01.455021 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-cefed812-e795-4c27-bdba-070e88362e38 req-4164a637-c876-4814-a4bf-ab523c228f4b service nova] Creating event network-changed:b455f4c7-2530-4f19-81ce-74ad3ad051a8 for instance 8836b61b-1200-4e32-825c-c6365bded08f on hv-cinder-81322 Jun 23 22:53:01.485059 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-cefed812-e795-4c27-bdba-070e88362e38 req-4164a637-c876-4814-a4bf-ab523c228f4b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069746 Jun 23 22:53:01.486604 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 481/980] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:02.171356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c5556105-dabd-4a22-9e3f-98810264e385 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Action: 'create', calling method: .version_select at 0x7fbbceb9a790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1862962156"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:02.860082 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0aa30596-a44d-40c6-8cce-18243ce3366f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:02.860700 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0aa30596-a44d-40c6-8cce-18243ce3366f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:02.881328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0aa30596-a44d-40c6-8cce-18243ce3366f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:02.888538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0aa30596-a44d-40c6-8cce-18243ce3366f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:02.889559 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0aa30596-a44d-40c6-8cce-18243ce3366f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:02.890008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0aa30596-a44d-40c6-8cce-18243ce3366f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:02.916785 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c5556105-dabd-4a22-9e3f-98810264e385 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.925255 Jun 23 22:53:02.918900 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 500/981] 10.222.0.33 () {60 vars in 1154 bytes} [Thu Jun 23 22:53:01 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 928 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 22:53:02.929959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f27c5cf4-f735-4153-9b50-a0bf775caa72 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcebc6b80>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:02.980221 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-0aa30596-a44d-40c6-8cce-18243ce3366f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lazy-loading 'services' on Instance uuid 8836b61b-1200-4e32-825c-c6365bded08f {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:53:02.986382 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f27c5cf4-f735-4153-9b50-a0bf775caa72 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 200 len: 345 microversion: 2.1 time: 0.060410 Jun 23 22:53:02.992294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 501/982] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:53:02 2022] GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:53:03.233384 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0aa30596-a44d-40c6-8cce-18243ce3366f tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments/081b76c0-1201-43cc-bae1-6235219ea22a" status: 202 len: 0 microversion: 2.1 time: 0.378444 Jun 23 22:53:03.234095 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 482/983] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:53:02 2022] DELETE /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments/081b76c0-1201-43cc-bae1-6235219ea22a => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:53:03.243173 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2417c052-6c9c-4000-8149-fea783916025 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:03.244120 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2417c052-6c9c-4000-8149-fea783916025 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:03.251986 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2417c052-6c9c-4000-8149-fea783916025 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:03.252438 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2417c052-6c9c-4000-8149-fea783916025 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:03.253257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2417c052-6c9c-4000-8149-fea783916025 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:03.253696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2417c052-6c9c-4000-8149-fea783916025 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:03.283206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2417c052-6c9c-4000-8149-fea783916025 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 Jun 23 22:53:03.287969 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 502/984] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:53:03 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:03.508171 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-450be1cf-da73-4e52-ac65-59f4a9eb79c6 req-20aae631-260d-4ea6-9066-f2f010817057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8836b61b-1200-4e32-825c-c6365bded08f", "tag": "b455f4c7-2530-4f19-81ce-74ad3ad051a8"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:03.515077 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-450be1cf-da73-4e52-ac65-59f4a9eb79c6 req-20aae631-260d-4ea6-9066-f2f010817057 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:03.515523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-450be1cf-da73-4e52-ac65-59f4a9eb79c6 req-20aae631-260d-4ea6-9066-f2f010817057 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:03.528092 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-450be1cf-da73-4e52-ac65-59f4a9eb79c6 req-20aae631-260d-4ea6-9066-f2f010817057 service nova] Creating event network-changed:b455f4c7-2530-4f19-81ce-74ad3ad051a8 for instance 8836b61b-1200-4e32-825c-c6365bded08f on hv-cinder-81322 Jun 23 22:53:03.533287 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-450be1cf-da73-4e52-ac65-59f4a9eb79c6 req-20aae631-260d-4ea6-9066-f2f010817057 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031386 Jun 23 22:53:03.533736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 483/985] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:03.999333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f99ba016-9d0a-4a31-a80a-00c231bcf56a tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbca34d160>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:04.045196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f99ba016-9d0a-4a31-a80a-00c231bcf56a tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 200 len: 345 microversion: 2.1 time: 0.049640 Jun 23 22:53:04.045751 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 503/986] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:53:03 2022] GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:04.296353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b2f7340e-20f3-44a3-8274-5267013947fc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:04.297384 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b2f7340e-20f3-44a3-8274-5267013947fc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:04.304334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2f7340e-20f3-44a3-8274-5267013947fc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:04.304804 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2f7340e-20f3-44a3-8274-5267013947fc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:04.305596 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2f7340e-20f3-44a3-8274-5267013947fc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:04.306033 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b2f7340e-20f3-44a3-8274-5267013947fc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:04.333924 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b2f7340e-20f3-44a3-8274-5267013947fc tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042289 Jun 23 22:53:04.334460 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 484/987] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:53:04 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:05.058317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f7025811-e532-438d-97c0-a1378bbf82e9 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcebc6e50>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:05.106289 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f7025811-e532-438d-97c0-a1378bbf82e9 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 200 len: 345 microversion: 2.1 time: 0.052184 Jun 23 22:53:05.106942 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 504/988] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:53:05 2022] GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:05.345501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b546baec-8532-4133-9e9e-aa213371c5ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:05.346533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b546baec-8532-4133-9e9e-aa213371c5ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:05.353174 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b546baec-8532-4133-9e9e-aa213371c5ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:05.353722 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b546baec-8532-4133-9e9e-aa213371c5ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:05.354690 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b546baec-8532-4133-9e9e-aa213371c5ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:05.355410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b546baec-8532-4133-9e9e-aa213371c5ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:05.384987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b546baec-8532-4133-9e9e-aa213371c5ad tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Jun 23 22:53:05.385538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 485/989] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:53:05 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:06.118821 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2b50924b-9e4f-4ba2-9779-fe200d7dd55f tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbca2db3a0>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:06.165778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2b50924b-9e4f-4ba2-9779-fe200d7dd55f tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 200 len: 346 microversion: 2.1 time: 0.051279 Jun 23 22:53:06.166354 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 505/990] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:53:06 2022] GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:06.184343 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-658c2776-eada-40e8-983e-84f6be1d32b7 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Action: 'create', calling method: .version_select at 0x7fbbcabcc040>, body: {"snapshot": {"volume_id": "fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1651661325"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:06.396485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-875c282f-d4f6-4c2c-90b8-ebac7e58afca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:06.397391 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-875c282f-d4f6-4c2c-90b8-ebac7e58afca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:06.403550 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-875c282f-d4f6-4c2c-90b8-ebac7e58afca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:06.403994 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-875c282f-d4f6-4c2c-90b8-ebac7e58afca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:06.404776 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-875c282f-d4f6-4c2c-90b8-ebac7e58afca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:06.405208 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-875c282f-d4f6-4c2c-90b8-ebac7e58afca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:06.433763 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-875c282f-d4f6-4c2c-90b8-ebac7e58afca tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041923 Jun 23 22:53:06.434313 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 506/991] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:53:06 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 22:53:06.444493 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:06.445016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:06.450748 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:06.451201 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:06.451959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:06.452404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:06.652361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-658c2776-eada-40e8-983e-84f6be1d32b7 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.470485 Jun 23 22:53:06.657037 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 486/992] 10.222.0.33 () {60 vars in 1161 bytes} [Thu Jun 23 22:53:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:06.662706 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3b6d9d30-f72a-4f17-9533-a51ac05e0300 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcab3a670>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:06.682505 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] HTTP exception thrown: Instance 8836b61b-1200-4e32-825c-c6365bded08f is not attached to volume 081b76c0-1201-43cc-bae1-6235219ea22a Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Request method failure captured: Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: DELETE /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments/081b76c0-1201-43cc-bae1-6235219ea22a HTTP/1.1 Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO4twtONo40ztlxJegevE_gvqnW9WBStk3gJ3TcMw997VuomD7B0AHczIiKXuY5u-TPuitDF25TXR1XRuya44-65VoIZb2EmzzWI_yjf5AX82Y1Cvm710E7K5bGPxUJ0SvbNe_BxVoUAPqO00dx7IC_Q3xYw8XdSudCThr2hq3cAzwc Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: e3f62d8ed71b424f8414e9c3eaa681aa Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-TestMinimumBasicScenario-1460211707 Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:53:06.684977 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3f62d8ed71b424f8414e9c3eaa681aa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3f62d8ed71b424f8414e9c3eaa681aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3f62d8ed71b424f8414e9c3eaa681aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3f62d8ed71b424f8414e9c3eaa681aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-TestMinimumBasicScenario-1460211707 Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: e3f62d8ed71b424f8414e9c3eaa681aa Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1460211707 Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-TestMinimumBasicScenario-1460211707-project Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: e6a2de8d5a514a73aa4e136b7afee9c2 Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-TestMinimumBasicScenario-1460211707-project Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:53:06.686410 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 8836b61b-1200-4e32-825c-c6365bded08f is not attached to volume 081b76c0-1201-43cc-bae1-6235219ea22a Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'server_id': '8836b61b-1200-4e32-825c-c6365bded08f', 'id': '081b76c0-1201-43cc-bae1-6235219ea22a'} Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 081b76c0-1201-43cc-bae1-6235219ea22a. Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:53:06.687177 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8836b61b-1200-4e32-825c-c6365bded08f is not attached to volume 081b76c0-1201-43cc-bae1-6235219ea22a Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8836b61b-1200-4e32-825c-c6365bded08f is not attached to volume 081b76c0-1201-43cc-bae1-6235219ea22a Jun 23 22:53:06.688727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:06.690586 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Returning 404 to user: Instance 8836b61b-1200-4e32-825c-c6365bded08f is not attached to volume 081b76c0-1201-43cc-bae1-6235219ea22a {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:53:06.691431 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9689b8d3-1f0c-4a82-8f3c-a686c71ce8da tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments/081b76c0-1201-43cc-bae1-6235219ea22a" status: 404 len: 154 microversion: 2.1 time: 0.251383 Jun 23 22:53:06.691976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 507/993] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:53:06 2022] DELETE /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f/os-volume_attachments/081b76c0-1201-43cc-bae1-6235219ea22a => generated 154 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:53:06.699283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3b6d9d30-f72a-4f17-9533-a51ac05e0300 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 200 len: 287 microversion: 2.1 time: 0.040724 Jun 23 22:53:06.699897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 487/994] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 22:53:06 2022] GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:06.710241 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5bf9ab1a-403b-46f5-98a7-af57cb021933 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbca5ed280>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:06.738928 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5bf9ab1a-403b-46f5-98a7-af57cb021933 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033096 Jun 23 22:53:06.739536 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 508/995] 10.222.0.33 () {58 vars in 1139 bytes} [Thu Jun 23 22:53:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:06.749670 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e44512e8-e311-4ade-b4f5-14fa76797df9 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcab88ee0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:06.783636 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e44512e8-e311-4ade-b4f5-14fa76797df9 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 200 len: 287 microversion: 2.1 time: 0.036002 Jun 23 22:53:06.783636 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 488/996] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 22:53:06 2022] GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:07.794365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1e6b7f51-f7cf-4fd0-a9d4-dac9d5572c1f tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbca3daaf0>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:07.823699 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1e6b7f51-f7cf-4fd0-a9d4-dac9d5572c1f tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 200 len: 287 microversion: 2.1 time: 0.033468 Jun 23 22:53:07.824243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 509/997] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 22:53:07 2022] GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:08.835516 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-821314f5-f4b5-40b1-904d-a4a5b69e1a9c tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcabcc700>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:08.864899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-821314f5-f4b5-40b1-904d-a4a5b69e1a9c tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 200 len: 287 microversion: 2.1 time: 0.033622 Jun 23 22:53:08.866184 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 489/998] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 22:53:08 2022] GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:09.877260 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f4babdb1-7d0e-4743-8233-888d117debfd tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcebed550>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:09.906710 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f4babdb1-7d0e-4743-8233-888d117debfd tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 200 len: 287 microversion: 2.1 time: 0.033739 Jun 23 22:53:09.907257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 510/999] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 22:53:09 2022] GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:10.919389 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-348a5a5e-4197-40e2-b300-a79ad15ef428 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcab888b0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:10.955540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-348a5a5e-4197-40e2-b300-a79ad15ef428 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 200 len: 288 microversion: 2.1 time: 0.035028 Jun 23 22:53:10.956482 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 490/1000] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 22:53:10 2022] GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:10.967021 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b0fccf50-63b7-4df7-83fa-37c7b5ac5b51 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbca30c700>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:11.094405 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b0fccf50-63b7-4df7-83fa-37c7b5ac5b51 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 202 len: 0 microversion: 2.1 time: 0.131619 Jun 23 22:53:11.095050 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 511/1001] 10.222.0.33 () {58 vars in 1253 bytes} [Thu Jun 23 22:53:10 2022] DELETE /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:53:11.104210 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3b8d2ad4-a791-448a-afa3-094700f25b83 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcab88550>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:11.121989 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e4d30ede-f47b-4dd1-bed9-ff8c97a763af tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:11.122491 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e4d30ede-f47b-4dd1-bed9-ff8c97a763af tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:11.128920 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4d30ede-f47b-4dd1-bed9-ff8c97a763af tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:11.129381 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4d30ede-f47b-4dd1-bed9-ff8c97a763af tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:11.130144 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4d30ede-f47b-4dd1-bed9-ff8c97a763af tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:11.130585 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4d30ede-f47b-4dd1-bed9-ff8c97a763af tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:11.134557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3b8d2ad4-a791-448a-afa3-094700f25b83 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 200 len: 287 microversion: 2.1 time: 0.034980 Jun 23 22:53:11.135140 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 491/1002] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 22:53:11 2022] GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:53:11.155032 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e4d30ede-f47b-4dd1-bed9-ff8c97a763af tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:53:11.450697 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e4d30ede-f47b-4dd1-bed9-ff8c97a763af tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 204 len: 0 microversion: 2.1 time: 0.332905 Jun 23 22:53:11.451608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 512/1003] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:53:11 2022] DELETE /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:53:11.461898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-20c4524b-01b3-4594-8091-929ccb777ff1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:11.462622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-20c4524b-01b3-4594-8091-929ccb777ff1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:11.469003 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-20c4524b-01b3-4594-8091-929ccb777ff1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:11.469520 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-20c4524b-01b3-4594-8091-929ccb777ff1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:11.470350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-20c4524b-01b3-4594-8091-929ccb777ff1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:11.470850 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-20c4524b-01b3-4594-8091-929ccb777ff1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:11.604096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-20c4524b-01b3-4594-8091-929ccb777ff1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:11.611850 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-20c4524b-01b3-4594-8091-929ccb777ff1 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1555 microversion: 2.1 time: 0.153991 Jun 23 22:53:11.612427 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 492/1004] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:11 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:12.147466 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b18b16ea-eb3e-4d6e-a51a-674ddb1e5636 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcebedb80>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:12.173245 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-b18b16ea-eb3e-4d6e-a51a-674ddb1e5636 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] HTTP exception thrown: Snapshot 3ab254c7-6789-4de9-96e4-5c4ae1c4b586 could not be found. Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b18b16ea-eb3e-4d6e-a51a-674ddb1e5636 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Request method failure captured: Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 HTTP/1.1 Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO7NklU66xSgLCS6GaFFV-VUL3PZx5Xe1cH8Hzq7XnQubya8EQfE3vN8pnJom66lrMG8VlmZE09PNPiS4A0zrbYecf3TH60nrwEAmwuRujMtVoL0gWNE9EhwIUGwFE2GFIsK-zykr9WPsxYxJYCu_Ow7np8t0UNP5TFzlMbzK4kRU7Y Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: c438364dd80f44cd90ae5c2b9228a094 Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:53:12.176408 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c438364dd80f44cd90ae5c2b9228a094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: c438364dd80f44cd90ae5c2b9228a094 Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-VolumesSnapshotsTestJSON-1066834447-project Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 58fd3740e2ba4bfc90abce2b44cc2f64 Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1066834447-project Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Snapshot 3ab254c7-6789-4de9-96e4-5c4ae1c4b586 could not be found. Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '3ab254c7-6789-4de9-96e4-5c4ae1c4b586'} Jun 23 22:53:12.178527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3ab254c7-6789-4de9-96e4-5c4ae1c4b586 could not be found. (HTTP 404) (Request-ID: req-a498d0a8-9822-4e3f-8cca-38ef7fa33f85) Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:12.179829 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:53:12.181327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3ab254c7-6789-4de9-96e4-5c4ae1c4b586 could not be found. Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 22:53:12.182959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3ab254c7-6789-4de9-96e4-5c4ae1c4b586 could not be found. Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3ab254c7-6789-4de9-96e4-5c4ae1c4b586 could not be found. Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b18b16ea-eb3e-4d6e-a51a-674ddb1e5636 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Returning 404 to user: Snapshot 3ab254c7-6789-4de9-96e4-5c4ae1c4b586 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:53:12.184619 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b18b16ea-eb3e-4d6e-a51a-674ddb1e5636 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586" status: 404 len: 111 microversion: 2.1 time: 0.035250 Jun 23 22:53:12.186002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 513/1005] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 22:53:12 2022] GET /compute/v2.1/os-snapshots/3ab254c7-6789-4de9-96e4-5c4ae1c4b586 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:53:12.187462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6af40c27-ea56-4140-97bf-a024c56d3611 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcabef310>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:12.404433 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6af40c27-ea56-4140-97bf-a024c56d3611 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 202 len: 0 microversion: 2.1 time: 0.220988 Jun 23 22:53:12.405045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 493/1006] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:53:12 2022] DELETE /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:53:12.416350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6947aef0-2d68-4be0-9f69-930b846bd0ed tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbca3d3430>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:12.463672 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6947aef0-2d68-4be0-9f69-930b846bd0ed tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 200 len: 345 microversion: 2.1 time: 0.053960 Jun 23 22:53:12.464227 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 514/1007] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:53:12 2022] GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:12.628380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1321c834-93f8-4362-a4de-4a7a4c8c83b9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:12.629015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1321c834-93f8-4362-a4de-4a7a4c8c83b9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:12.635185 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1321c834-93f8-4362-a4de-4a7a4c8c83b9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:12.637198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1321c834-93f8-4362-a4de-4a7a4c8c83b9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:12.637198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1321c834-93f8-4362-a4de-4a7a4c8c83b9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:12.637198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1321c834-93f8-4362-a4de-4a7a4c8c83b9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:12.765095 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1321c834-93f8-4362-a4de-4a7a4c8c83b9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:12.773475 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1321c834-93f8-4362-a4de-4a7a4c8c83b9 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1555 microversion: 2.1 time: 0.149007 Jun 23 22:53:12.774029 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 494/1008] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:12 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:53:13.475932 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2e6f2217-4134-4f7c-949c-c5c1e291bb48 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbca2dbb80>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:13.503665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-2e6f2217-4134-4f7c-949c-c5c1e291bb48 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] HTTP exception thrown: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2e6f2217-4134-4f7c-949c-c5c1e291bb48 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Request method failure captured: Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 HTTP/1.1 Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO7NklU66xSgLCS6GaFFV-VUL3PZx5Xe1cH8Hzq7XnQubya8EQfE3vN8pnJom66lrMG8VlmZE09PNPiS4A0zrbYecf3TH60nrwEAmwuRujMtVoL0gWNE9EhwIUGwFE2GFIsK-zykr9WPsxYxJYCu_Ow7np8t0UNP5TFzlMbzK4kRU7Y Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: c438364dd80f44cd90ae5c2b9228a094 Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:53:13.506469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c438364dd80f44cd90ae5c2b9228a094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: c438364dd80f44cd90ae5c2b9228a094 Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-VolumesSnapshotsTestJSON-1066834447-project Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 58fd3740e2ba4bfc90abce2b44cc2f64 Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1066834447-project Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': 'fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4'} Jun 23 22:53:13.508302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. (HTTP 404) (Request-ID: req-14ef45b6-d0ed-428c-8f35-a5bdc5dafbc0) Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.509483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:53:13.511047 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 22:53:13.512537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2e6f2217-4134-4f7c-949c-c5c1e291bb48 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Returning 404 to user: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2e6f2217-4134-4f7c-949c-c5c1e291bb48 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 404 len: 109 microversion: 2.1 time: 0.036671 Jun 23 22:53:13.514299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 515/1009] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:53:13 2022] GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:53:13.522550 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c72b93e0-55fd-4969-88ba-2d4ed8ac6a37 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbca2368b0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:13.550340 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-c72b93e0-55fd-4969-88ba-2d4ed8ac6a37 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] HTTP exception thrown: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c72b93e0-55fd-4969-88ba-2d4ed8ac6a37 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Request method failure captured: Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 HTTP/1.1 Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO7NklU66xSgLCS6GaFFV-VUL3PZx5Xe1cH8Hzq7XnQubya8EQfE3vN8pnJom66lrMG8VlmZE09PNPiS4A0zrbYecf3TH60nrwEAmwuRujMtVoL0gWNE9EhwIUGwFE2GFIsK-zykr9WPsxYxJYCu_Ow7np8t0UNP5TFzlMbzK4kRU7Y Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: c438364dd80f44cd90ae5c2b9228a094 Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:53:13.553118 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c438364dd80f44cd90ae5c2b9228a094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: c438364dd80f44cd90ae5c2b9228a094 Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesSnapshotsTestJSON-1066834447-project Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 58fd3740e2ba4bfc90abce2b44cc2f64 Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1066834447-project Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': 'fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4'} Jun 23 22:53:13.554887 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. (HTTP 404) (Request-ID: req-91e1607e-b01a-4e7e-96b7-52cc1f7f1c97) Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.555810 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 22:53:13.557275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 22:53:13.558708 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c72b93e0-55fd-4969-88ba-2d4ed8ac6a37 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Returning 404 to user: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:53:13.560224 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c72b93e0-55fd-4969-88ba-2d4ed8ac6a37 tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 404 len: 109 microversion: 2.1 time: 0.036646 Jun 23 22:53:13.561310 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 495/1010] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:53:13 2022] DELETE /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:53:13.562845 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ea249738-b2b9-46d0-abb1-9ffd21fc868d tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Calling method '.version_select at 0x7fbbcebc6940>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:13.591353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-ea249738-b2b9-46d0-abb1-9ffd21fc868d tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] HTTP exception thrown: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ea249738-b2b9-46d0-abb1-9ffd21fc868d tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Request method failure captured: Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 HTTP/1.1 Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO7NklU66xSgLCS6GaFFV-VUL3PZx5Xe1cH8Hzq7XnQubya8EQfE3vN8pnJom66lrMG8VlmZE09PNPiS4A0zrbYecf3TH60nrwEAmwuRujMtVoL0gWNE9EhwIUGwFE2GFIsK-zykr9WPsxYxJYCu_Ow7np8t0UNP5TFzlMbzK4kRU7Y Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: c438364dd80f44cd90ae5c2b9228a094 Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:53:13.593327 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c438364dd80f44cd90ae5c2b9228a094", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c438364dd80f44cd90ae5c2b9228a094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: c438364dd80f44cd90ae5c2b9228a094 Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1066834447 Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-VolumesSnapshotsTestJSON-1066834447-project Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 58fd3740e2ba4bfc90abce2b44cc2f64 Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1066834447-project Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': 'fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4'} Jun 23 22:53:13.594872 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. (HTTP 404) (Request-ID: req-71d837e4-af1a-452a-b301-a5609e22a801) Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.595815 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 22:53:13.597027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 22:53:13.598157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ea249738-b2b9-46d0-abb1-9ffd21fc868d tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] Returning 404 to user: Volume fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ea249738-b2b9-46d0-abb1-9ffd21fc868d tempest-VolumesSnapshotsTestJSON-1066834447 tempest-VolumesSnapshotsTestJSON-1066834447-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4" status: 404 len: 109 microversion: 2.1 time: 0.035620 Jun 23 22:53:13.599463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 516/1011] 10.222.0.33 () {58 vars in 1244 bytes} [Thu Jun 23 22:53:13 2022] GET /compute/v2.1/os-volumes/fa38fc3f-ed41-492c-abe1-ce7b8c8c4bd4 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:53:13.790726 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5c34e243-6155-4019-9a0d-b2a6fec25c56 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:13.791251 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5c34e243-6155-4019-9a0d-b2a6fec25c56 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:13.798229 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c34e243-6155-4019-9a0d-b2a6fec25c56 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:13.798673 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c34e243-6155-4019-9a0d-b2a6fec25c56 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:13.799504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c34e243-6155-4019-9a0d-b2a6fec25c56 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:13.799943 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5c34e243-6155-4019-9a0d-b2a6fec25c56 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:13.932117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5c34e243-6155-4019-9a0d-b2a6fec25c56 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:13.939920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5c34e243-6155-4019-9a0d-b2a6fec25c56 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1555 microversion: 2.1 time: 0.153163 Jun 23 22:53:13.940641 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 496/1012] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:13 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:14.957392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9f2fa7d0-2d54-48b9-843b-84da182be7f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:14.958131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9f2fa7d0-2d54-48b9-843b-84da182be7f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:14.964812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f2fa7d0-2d54-48b9-843b-84da182be7f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:14.965460 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f2fa7d0-2d54-48b9-843b-84da182be7f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:14.966226 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f2fa7d0-2d54-48b9-843b-84da182be7f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:14.966666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f2fa7d0-2d54-48b9-843b-84da182be7f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:15.094947 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9f2fa7d0-2d54-48b9-843b-84da182be7f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:15.102610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9f2fa7d0-2d54-48b9-843b-84da182be7f7 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1555 microversion: 2.1 time: 0.149408 Jun 23 22:53:15.103106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 517/1013] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:14 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:16.119952 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b584819f-2271-4700-b99d-b7fedbd78338 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:16.120614 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b584819f-2271-4700-b99d-b7fedbd78338 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:16.127450 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b584819f-2271-4700-b99d-b7fedbd78338 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:16.127893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b584819f-2271-4700-b99d-b7fedbd78338 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:16.128680 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b584819f-2271-4700-b99d-b7fedbd78338 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:16.129145 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b584819f-2271-4700-b99d-b7fedbd78338 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:16.259945 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b584819f-2271-4700-b99d-b7fedbd78338 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:16.267568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b584819f-2271-4700-b99d-b7fedbd78338 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1555 microversion: 2.1 time: 0.151616 Jun 23 22:53:16.268134 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 497/1014] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:16 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:17.022212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-bc9985df-673c-412c-bc7d-1ac3d69fb2d2 req-799ec57b-9889-4f6d-846d-6eb8f27fafb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8836b61b-1200-4e32-825c-c6365bded08f", "name": "network-vif-deleted", "tag": "b455f4c7-2530-4f19-81ce-74ad3ad051a8"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:17.031278 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-bc9985df-673c-412c-bc7d-1ac3d69fb2d2 req-799ec57b-9889-4f6d-846d-6eb8f27fafb1 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:17.031722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-bc9985df-673c-412c-bc7d-1ac3d69fb2d2 req-799ec57b-9889-4f6d-846d-6eb8f27fafb1 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:17.043890 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-bc9985df-673c-412c-bc7d-1ac3d69fb2d2 req-799ec57b-9889-4f6d-846d-6eb8f27fafb1 service nova] Creating event network-vif-deleted:b455f4c7-2530-4f19-81ce-74ad3ad051a8 for instance 8836b61b-1200-4e32-825c-c6365bded08f on hv-cinder-81322 Jun 23 22:53:17.049044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-bc9985df-673c-412c-bc7d-1ac3d69fb2d2 req-799ec57b-9889-4f6d-846d-6eb8f27fafb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Jun 23 22:53:17.049791 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 518/1015] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:53:17.285552 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ab22bbe7-c3ff-4b5d-8dbc-83ef633bd8c8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:17.286182 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ab22bbe7-c3ff-4b5d-8dbc-83ef633bd8c8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:17.295044 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab22bbe7-c3ff-4b5d-8dbc-83ef633bd8c8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:17.295502 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab22bbe7-c3ff-4b5d-8dbc-83ef633bd8c8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:17.296294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab22bbe7-c3ff-4b5d-8dbc-83ef633bd8c8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:17.296837 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab22bbe7-c3ff-4b5d-8dbc-83ef633bd8c8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:17.363320 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ab22bbe7-c3ff-4b5d-8dbc-83ef633bd8c8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a2de8d5a514a73aa4e136b7afee9c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3f62d8ed71b424f8414e9c3eaa681aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:17.386623 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ab22bbe7-c3ff-4b5d-8dbc-83ef633bd8c8 tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 200 len: 1344 microversion: 2.1 time: 0.105025 Jun 23 22:53:17.388719 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 498/1016] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:17 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 1344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:18.404602 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:18.405309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] [instance: 8836b61b-1200-4e32-825c-c6365bded08f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:18.412337 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:18.413007 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:18.413887 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:18.414384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:18.428481 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] HTTP exception thrown: Instance 8836b61b-1200-4e32-825c-c6365bded08f could not be found. Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Request method failure captured: Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f HTTP/1.1 Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO4twtONo40ztlxJegevE_gvqnW9WBStk3gJ3TcMw997VuomD7B0AHczIiKXuY5u-TPuitDF25TXR1XRuya44-65VoIZb2EmzzWI_yjf5AX82Y1Cvm710E7K5bGPxUJ0SvbNe_BxVoUAPqO00dx7IC_Q3xYw8XdSudCThr2hq3cAzwc Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: e3f62d8ed71b424f8414e9c3eaa681aa Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-TestMinimumBasicScenario-1460211707 Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:53:18.430263 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3f62d8ed71b424f8414e9c3eaa681aa", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3f62d8ed71b424f8414e9c3eaa681aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3f62d8ed71b424f8414e9c3eaa681aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3f62d8ed71b424f8414e9c3eaa681aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-TestMinimumBasicScenario-1460211707 Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: e3f62d8ed71b424f8414e9c3eaa681aa Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1460211707 Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-TestMinimumBasicScenario-1460211707-project Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: e6a2de8d5a514a73aa4e136b7afee9c2 Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-TestMinimumBasicScenario-1460211707-project Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 8836b61b-1200-4e32-825c-c6365bded08f could not be found. Jun 23 22:53:18.431846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '8836b61b-1200-4e32-825c-c6365bded08f'} Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8836b61b-1200-4e32-825c-c6365bded08f could not be found. Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:53:18.432803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8836b61b-1200-4e32-825c-c6365bded08f could not be found. Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8836b61b-1200-4e32-825c-c6365bded08f could not be found. Jun 23 22:53:18.434468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:53:18.435754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Returning 404 to user: Instance 8836b61b-1200-4e32-825c-c6365bded08f could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:53:18.435754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e0ba2e68-bf73-4bc2-a7d1-3ac870300a6c tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f" status: 404 len: 111 microversion: 2.1 time: 0.031893 Jun 23 22:53:18.435754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 519/1017] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:18 2022] GET /compute/v2.1/servers/8836b61b-1200-4e32-825c-c6365bded08f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:53:18.440294 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-52d7995b-f4e1-4782-8680-9e171107973e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] Calling method '.version_select at 0x7fbbcabccaf0>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:18.520308 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-52d7995b-f4e1-4782-8680-9e171107973e tempest-TestMinimumBasicScenario-1460211707 tempest-TestMinimumBasicScenario-1460211707-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1500613934" status: 202 len: 0 microversion: 2.1 time: 0.083630 Jun 23 22:53:18.521008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 499/1018] 10.222.0.33 () {58 vars in 1271 bytes} [Thu Jun 23 22:53:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1500613934 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:53:36.188392 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f57ccb64-53df-44b1-a3a1-7ebd6dcbfe90 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:36.189016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f57ccb64-53df-44b1-a3a1-7ebd6dcbfe90 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:36.191868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:36.192626 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:36.198499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f57ccb64-53df-44b1-a3a1-7ebd6dcbfe90 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:36.201995 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f57ccb64-53df-44b1-a3a1-7ebd6dcbfe90 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:36.201995 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f57ccb64-53df-44b1-a3a1-7ebd6dcbfe90 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:36.201995 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f57ccb64-53df-44b1-a3a1-7ebd6dcbfe90 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:36.282129 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-f57ccb64-53df-44b1-a3a1-7ebd6dcbfe90 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lazy-loading 'services' on Instance uuid 60601697-91f9-4db0-9d49-5fdd0ff5387f {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:53:36.507366 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f57ccb64-53df-44b1-a3a1-7ebd6dcbfe90 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/os-volume_attachments/91cd2895-1168-4efe-bb9e-65c0e474ee8a" status: 202 len: 0 microversion: 2.1 time: 0.322736 Jun 23 22:53:36.511765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 520/1019] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:53:36 2022] DELETE /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/os-volume_attachments/91cd2895-1168-4efe-bb9e-65c0e474ee8a => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:53:37.676597 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:37.677338 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:37.681376 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c31c9baa-db06-41f4-99df-621a36fdc9bd tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:37.687620 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c31c9baa-db06-41f4-99df-621a36fdc9bd tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:37.688075 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c31c9baa-db06-41f4-99df-621a36fdc9bd tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:37.749120 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c31c9baa-db06-41f4-99df-621a36fdc9bd tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Going to try to stop instance {{(pid=124725) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 22:53:37.938552 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c31c9baa-db06-41f4-99df-621a36fdc9bd tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/action" status: 202 len: 0 microversion: 2.1 time: 0.263212 Jun 23 22:53:37.939163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 500/1020] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:53:37 2022] POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:53:37.948521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-082a4544-601e-499a-8941-4dd05bef14a3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:37.949254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-082a4544-601e-499a-8941-4dd05bef14a3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:37.956889 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-082a4544-601e-499a-8941-4dd05bef14a3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:37.957347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-082a4544-601e-499a-8941-4dd05bef14a3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:37.958107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-082a4544-601e-499a-8941-4dd05bef14a3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:37.959193 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-082a4544-601e-499a-8941-4dd05bef14a3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:38.095560 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-082a4544-601e-499a-8941-4dd05bef14a3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:38.110192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-082a4544-601e-499a-8941-4dd05bef14a3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.165947 Jun 23 22:53:38.110778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 521/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:37 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:39.129395 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-38ea894e-d814-4f2c-9fdf-13e74d904ade tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:39.132871 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-38ea894e-d814-4f2c-9fdf-13e74d904ade tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:39.137551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38ea894e-d814-4f2c-9fdf-13e74d904ade tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:39.138074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38ea894e-d814-4f2c-9fdf-13e74d904ade tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:39.138777 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38ea894e-d814-4f2c-9fdf-13e74d904ade tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:39.139219 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-38ea894e-d814-4f2c-9fdf-13e74d904ade tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:39.275835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-38ea894e-d814-4f2c-9fdf-13e74d904ade tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:39.283832 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-38ea894e-d814-4f2c-9fdf-13e74d904ade tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.159836 Jun 23 22:53:39.295797 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 501/1022] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:39 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:40.303905 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a284b5dc-f9d8-4f61-9476-6583ef26faef tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:40.304532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a284b5dc-f9d8-4f61-9476-6583ef26faef tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:40.311195 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a284b5dc-f9d8-4f61-9476-6583ef26faef tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:40.311650 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a284b5dc-f9d8-4f61-9476-6583ef26faef tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:40.312447 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a284b5dc-f9d8-4f61-9476-6583ef26faef tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:40.312919 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a284b5dc-f9d8-4f61-9476-6583ef26faef tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:40.453037 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a284b5dc-f9d8-4f61-9476-6583ef26faef tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:40.461245 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a284b5dc-f9d8-4f61-9476-6583ef26faef tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.162876 Jun 23 22:53:40.461802 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 522/1023] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:40 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:41.478890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b5a74298-2988-4ae7-a649-c2e12d577685 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:41.479498 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b5a74298-2988-4ae7-a649-c2e12d577685 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:41.487101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b5a74298-2988-4ae7-a649-c2e12d577685 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:41.487551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b5a74298-2988-4ae7-a649-c2e12d577685 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:41.488300 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b5a74298-2988-4ae7-a649-c2e12d577685 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:41.488770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b5a74298-2988-4ae7-a649-c2e12d577685 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:41.626405 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b5a74298-2988-4ae7-a649-c2e12d577685 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:41.634249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b5a74298-2988-4ae7-a649-c2e12d577685 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.159853 Jun 23 22:53:41.634800 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 502/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:41 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:42.652180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-90d5eea7-ef59-4fb5-b356-b88d960defaa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:42.652836 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-90d5eea7-ef59-4fb5-b356-b88d960defaa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:42.659278 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-90d5eea7-ef59-4fb5-b356-b88d960defaa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:42.659731 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-90d5eea7-ef59-4fb5-b356-b88d960defaa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:42.660488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-90d5eea7-ef59-4fb5-b356-b88d960defaa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:42.660952 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-90d5eea7-ef59-4fb5-b356-b88d960defaa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:42.791182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-90d5eea7-ef59-4fb5-b356-b88d960defaa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:42.798873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-90d5eea7-ef59-4fb5-b356-b88d960defaa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.151231 Jun 23 22:53:42.799425 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 523/1025] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:42 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:43.151244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1221305839", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "networks": [{"uuid": "8a74ee39-3743-4024-9b72-eae7e4ba12b3"}]}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:43.206107 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] validate_networks() for [('8a74ee39-3743-4024-9b72-eae7e4ba12b3', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:53:43.562268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:53:43.562724 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:53:43.563221 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:53:43.563637 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:53:43.564055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:53:43.573996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:43.574540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:43.575361 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:43.575797 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:43.592669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Getting quotas for project 7cee5e6784454293bc02e0e595d58b22. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:53:43.596557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Getting quotas for user 2dcf17b8ad9349458e3328ebc2984902 and project 7cee5e6784454293bc02e0e595d58b22. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:53:43.608269 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:53:43.610665 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:53:43.705834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-86baa103-4ad8-4654-9d5a-119d2c056edd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558527 Jun 23 22:53:43.706475 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 503/1026] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:53:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:53:43.716599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a9d7fd7e-2436-4abd-a876-0b7721c05604 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:43.717212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a9d7fd7e-2436-4abd-a876-0b7721c05604 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:43.793883 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-a9d7fd7e-2436-4abd-a876-0b7721c05604 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:43.796793 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a9d7fd7e-2436-4abd-a876-0b7721c05604 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1214 microversion: 2.1 time: 0.084188 Jun 23 22:53:43.797636 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 524/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:43 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:43.822456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-08161d75-b412-49e2-918a-77a5fefbb45f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:43.823067 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-08161d75-b412-49e2-918a-77a5fefbb45f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:43.829698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08161d75-b412-49e2-918a-77a5fefbb45f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:43.833679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08161d75-b412-49e2-918a-77a5fefbb45f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:43.833679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08161d75-b412-49e2-918a-77a5fefbb45f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:43.833679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-08161d75-b412-49e2-918a-77a5fefbb45f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:43.967263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-08161d75-b412-49e2-918a-77a5fefbb45f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:43.974919 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-08161d75-b412-49e2-918a-77a5fefbb45f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.157134 Jun 23 22:53:43.975479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 504/1028] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:43 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:44.816979 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7beb71c1-4099-4670-b102-a2fc755e4e35 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:44.817592 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7beb71c1-4099-4670-b102-a2fc755e4e35 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:44.825454 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7beb71c1-4099-4670-b102-a2fc755e4e35 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:44.825910 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7beb71c1-4099-4670-b102-a2fc755e4e35 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:44.826676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7beb71c1-4099-4670-b102-a2fc755e4e35 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:44.827119 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7beb71c1-4099-4670-b102-a2fc755e4e35 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:44.889671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7beb71c1-4099-4670-b102-a2fc755e4e35 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:44.897007 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7beb71c1-4099-4670-b102-a2fc755e4e35 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1218 microversion: 2.1 time: 0.083826 Jun 23 22:53:44.897567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 525/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:44 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:44.993914 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a5f44174-c392-4a5b-851c-c90300779d2e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:44.995505 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a5f44174-c392-4a5b-851c-c90300779d2e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:45.004017 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5f44174-c392-4a5b-851c-c90300779d2e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:45.004476 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5f44174-c392-4a5b-851c-c90300779d2e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:45.005305 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5f44174-c392-4a5b-851c-c90300779d2e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:45.005776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a5f44174-c392-4a5b-851c-c90300779d2e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:45.142185 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a5f44174-c392-4a5b-851c-c90300779d2e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:45.149851 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a5f44174-c392-4a5b-851c-c90300779d2e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.160677 Jun 23 22:53:45.151762 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 505/1030] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:44 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:45.914794 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-adbc51bf-ef17-4578-982a-065f03683614 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:45.915404 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-adbc51bf-ef17-4578-982a-065f03683614 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:45.921981 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-adbc51bf-ef17-4578-982a-065f03683614 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:45.922424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-adbc51bf-ef17-4578-982a-065f03683614 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:45.923184 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-adbc51bf-ef17-4578-982a-065f03683614 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:45.923622 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-adbc51bf-ef17-4578-982a-065f03683614 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:45.986016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-adbc51bf-ef17-4578-982a-065f03683614 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:46.003169 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-adbc51bf-ef17-4578-982a-065f03683614 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1274 microversion: 2.1 time: 0.085365 Jun 23 22:53:46.003169 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 526/1031] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:45 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:46.172745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a0fcd8d2-3704-436a-8f49-de4596f2165e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:46.173358 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a0fcd8d2-3704-436a-8f49-de4596f2165e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:46.179942 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a0fcd8d2-3704-436a-8f49-de4596f2165e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:46.180394 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a0fcd8d2-3704-436a-8f49-de4596f2165e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:46.181808 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a0fcd8d2-3704-436a-8f49-de4596f2165e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:46.182249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a0fcd8d2-3704-436a-8f49-de4596f2165e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:46.414526 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a0fcd8d2-3704-436a-8f49-de4596f2165e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:46.423074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a0fcd8d2-3704-436a-8f49-de4596f2165e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.254028 Jun 23 22:53:46.424089 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 506/1032] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:46 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:47.015035 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-07fd2b90-1d77-47c8-bf3b-6acfcc5f568f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:47.015732 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-07fd2b90-1d77-47c8-bf3b-6acfcc5f568f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:47.022156 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-07fd2b90-1d77-47c8-bf3b-6acfcc5f568f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:47.022677 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-07fd2b90-1d77-47c8-bf3b-6acfcc5f568f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:47.023742 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-07fd2b90-1d77-47c8-bf3b-6acfcc5f568f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:47.024192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-07fd2b90-1d77-47c8-bf3b-6acfcc5f568f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:47.164182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-07fd2b90-1d77-47c8-bf3b-6acfcc5f568f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:47.172423 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-07fd2b90-1d77-47c8-bf3b-6acfcc5f568f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1314 microversion: 2.1 time: 0.161399 Jun 23 22:53:47.173036 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 527/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:47 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:47.440571 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-efaef6d0-88ff-4835-9551-35f1ae456833 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:47.441187 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-efaef6d0-88ff-4835-9551-35f1ae456833 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:47.448925 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efaef6d0-88ff-4835-9551-35f1ae456833 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:47.449371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efaef6d0-88ff-4835-9551-35f1ae456833 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:47.450296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efaef6d0-88ff-4835-9551-35f1ae456833 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:47.450786 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-efaef6d0-88ff-4835-9551-35f1ae456833 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:47.635060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-efaef6d0-88ff-4835-9551-35f1ae456833 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:47.642561 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-efaef6d0-88ff-4835-9551-35f1ae456833 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1678 microversion: 2.1 time: 0.206285 Jun 23 22:53:47.643121 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 507/1034] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:47 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1678 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:47.716670 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-96f6ea63-3ad2-4b64-948a-d825b2b46e48 req-23a0dca0-cb37-486f-b1b1-5137752eb32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b9e52f2-84db-45a9-9256-09005fdd9344", "tag": "f2cc4f9b-a6e7-4636-b373-47327b099ade"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:47.727192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-96f6ea63-3ad2-4b64-948a-d825b2b46e48 req-23a0dca0-cb37-486f-b1b1-5137752eb32c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:47.727323 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-96f6ea63-3ad2-4b64-948a-d825b2b46e48 req-23a0dca0-cb37-486f-b1b1-5137752eb32c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:47.740153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-96f6ea63-3ad2-4b64-948a-d825b2b46e48 req-23a0dca0-cb37-486f-b1b1-5137752eb32c service nova] Creating event network-changed:f2cc4f9b-a6e7-4636-b373-47327b099ade for instance 3b9e52f2-84db-45a9-9256-09005fdd9344 on hv-cinder-81322 Jun 23 22:53:47.746167 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-96f6ea63-3ad2-4b64-948a-d825b2b46e48 req-23a0dca0-cb37-486f-b1b1-5137752eb32c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033036 Jun 23 22:53:47.751376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 528/1035] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:47.944735 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:53:47.945003 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Thu Jun 23 22:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:53:48.189935 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ae3a4c00-9be8-40f1-a3e4-b23da368286e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:48.190572 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ae3a4c00-9be8-40f1-a3e4-b23da368286e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:48.196564 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae3a4c00-9be8-40f1-a3e4-b23da368286e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:48.197039 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae3a4c00-9be8-40f1-a3e4-b23da368286e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:48.197796 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae3a4c00-9be8-40f1-a3e4-b23da368286e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:48.198235 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ae3a4c00-9be8-40f1-a3e4-b23da368286e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:48.378671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ae3a4c00-9be8-40f1-a3e4-b23da368286e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:48.387313 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ae3a4c00-9be8-40f1-a3e4-b23da368286e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1314 microversion: 2.1 time: 0.201335 Jun 23 22:53:48.387926 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 508/1036] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:48 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:48.660203 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-30e88ae5-8e8e-4d11-9097-914cb83fa0c8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:48.660942 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-30e88ae5-8e8e-4d11-9097-914cb83fa0c8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:48.668533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-30e88ae5-8e8e-4d11-9097-914cb83fa0c8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:48.669016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-30e88ae5-8e8e-4d11-9097-914cb83fa0c8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:48.669782 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-30e88ae5-8e8e-4d11-9097-914cb83fa0c8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:48.670227 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-30e88ae5-8e8e-4d11-9097-914cb83fa0c8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:48.806025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-30e88ae5-8e8e-4d11-9097-914cb83fa0c8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:48.813695 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-30e88ae5-8e8e-4d11-9097-914cb83fa0c8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1655 microversion: 2.1 time: 0.157809 Jun 23 22:53:48.814253 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 529/1037] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:48 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:48.830835 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c6cff36a-9623-41d9-bb31-401ad4ea5c54 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:48.839762 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6cff36a-9623-41d9-bb31-401ad4ea5c54 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:48.839762 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c6cff36a-9623-41d9-bb31-401ad4ea5c54 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:48.862098 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c6cff36a-9623-41d9-bb31-401ad4ea5c54 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Going to try to start instance {{(pid=124725) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 22:53:49.034505 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c6cff36a-9623-41d9-bb31-401ad4ea5c54 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/action" status: 202 len: 0 microversion: 2.1 time: 0.207314 Jun 23 22:53:49.035109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 509/1038] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 22:53:48 2022] POST /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:53:49.043481 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ec45b8f6-6916-4762-b79e-3f035f908012 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:49.044086 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ec45b8f6-6916-4762-b79e-3f035f908012 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:49.050087 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec45b8f6-6916-4762-b79e-3f035f908012 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:49.050559 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec45b8f6-6916-4762-b79e-3f035f908012 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:49.051304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec45b8f6-6916-4762-b79e-3f035f908012 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:49.051737 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ec45b8f6-6916-4762-b79e-3f035f908012 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:49.179118 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ec45b8f6-6916-4762-b79e-3f035f908012 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:49.187594 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ec45b8f6-6916-4762-b79e-3f035f908012 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1664 microversion: 2.1 time: 0.148354 Jun 23 22:53:49.188153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 530/1039] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:49 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:49.404096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d60e99e6-9b9a-4650-9776-11d5c06ae377 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:49.404843 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d60e99e6-9b9a-4650-9776-11d5c06ae377 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:49.411210 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60e99e6-9b9a-4650-9776-11d5c06ae377 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:49.411737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60e99e6-9b9a-4650-9776-11d5c06ae377 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:49.412725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60e99e6-9b9a-4650-9776-11d5c06ae377 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:49.413229 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d60e99e6-9b9a-4650-9776-11d5c06ae377 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:49.552787 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d60e99e6-9b9a-4650-9776-11d5c06ae377 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:49.560535 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d60e99e6-9b9a-4650-9776-11d5c06ae377 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1314 microversion: 2.1 time: 0.161133 Jun 23 22:53:49.561201 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 510/1040] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:49 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:50.205206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8149dc27-fda7-40d3-95ed-51a3aa89b070 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:50.206478 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8149dc27-fda7-40d3-95ed-51a3aa89b070 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:50.213839 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8149dc27-fda7-40d3-95ed-51a3aa89b070 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:50.218006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8149dc27-fda7-40d3-95ed-51a3aa89b070 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:50.218006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8149dc27-fda7-40d3-95ed-51a3aa89b070 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:50.218006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8149dc27-fda7-40d3-95ed-51a3aa89b070 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:50.350624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8149dc27-fda7-40d3-95ed-51a3aa89b070 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:50.358913 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8149dc27-fda7-40d3-95ed-51a3aa89b070 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1664 microversion: 2.1 time: 0.157976 Jun 23 22:53:50.359473 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 531/1041] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:50 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:50.578087 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-76c3b9c4-a730-42c1-999d-1ce113c70408 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:50.578693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-76c3b9c4-a730-42c1-999d-1ce113c70408 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:50.585410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76c3b9c4-a730-42c1-999d-1ce113c70408 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:50.585892 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76c3b9c4-a730-42c1-999d-1ce113c70408 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:50.586662 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76c3b9c4-a730-42c1-999d-1ce113c70408 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:50.587104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-76c3b9c4-a730-42c1-999d-1ce113c70408 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:50.712927 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-76c3b9c4-a730-42c1-999d-1ce113c70408 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:50.720307 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-76c3b9c4-a730-42c1-999d-1ce113c70408 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1314 microversion: 2.1 time: 0.146208 Jun 23 22:53:50.720909 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 511/1042] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:50 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:51.376777 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-caf8dc95-fb20-45ae-9f09-e82cf79da50b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:51.377389 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-caf8dc95-fb20-45ae-9f09-e82cf79da50b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:51.383787 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-caf8dc95-fb20-45ae-9f09-e82cf79da50b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:51.384230 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-caf8dc95-fb20-45ae-9f09-e82cf79da50b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:51.385564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-caf8dc95-fb20-45ae-9f09-e82cf79da50b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:51.386106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-caf8dc95-fb20-45ae-9f09-e82cf79da50b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:51.519102 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-caf8dc95-fb20-45ae-9f09-e82cf79da50b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:51.527862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-caf8dc95-fb20-45ae-9f09-e82cf79da50b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1668 microversion: 2.1 time: 0.154305 Jun 23 22:53:51.527862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 532/1043] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:51 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:51.737679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bf4d3915-05d7-4cad-b723-92fffb04716d tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:51.738328 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bf4d3915-05d7-4cad-b723-92fffb04716d tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:51.754036 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf4d3915-05d7-4cad-b723-92fffb04716d tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:51.754580 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf4d3915-05d7-4cad-b723-92fffb04716d tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:51.755554 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf4d3915-05d7-4cad-b723-92fffb04716d tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:51.756059 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf4d3915-05d7-4cad-b723-92fffb04716d tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:51.807102 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-c6bf71b7-673f-48f5-b7ca-331cdc616ed1 req-5b005710-180f-4962-9845-a1ea9dd40550 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9e52f2-84db-45a9-9256-09005fdd9344", "name": "network-vif-plugged", "status": "completed", "tag": "f2cc4f9b-a6e7-4636-b373-47327b099ade"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:51.816983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-c6bf71b7-673f-48f5-b7ca-331cdc616ed1 req-5b005710-180f-4962-9845-a1ea9dd40550 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:51.817432 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-c6bf71b7-673f-48f5-b7ca-331cdc616ed1 req-5b005710-180f-4962-9845-a1ea9dd40550 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:51.830012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-c6bf71b7-673f-48f5-b7ca-331cdc616ed1 req-5b005710-180f-4962-9845-a1ea9dd40550 service nova] Creating event network-vif-plugged:f2cc4f9b-a6e7-4636-b373-47327b099ade for instance 3b9e52f2-84db-45a9-9256-09005fdd9344 on hv-cinder-81322 Jun 23 22:53:51.835259 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-c6bf71b7-673f-48f5-b7ca-331cdc616ed1 req-5b005710-180f-4962-9845-a1ea9dd40550 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034304 Jun 23 22:53:51.835942 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 533/1044] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:53:51.899255 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bf4d3915-05d7-4cad-b723-92fffb04716d tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:51.906825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bf4d3915-05d7-4cad-b723-92fffb04716d tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1314 microversion: 2.1 time: 0.172941 Jun 23 22:53:51.907714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 512/1045] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:51 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:52.924666 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-997130bf-3ea7-414f-b24b-98cbae2e0d2f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:52.925354 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-997130bf-3ea7-414f-b24b-98cbae2e0d2f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:52.931810 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-997130bf-3ea7-414f-b24b-98cbae2e0d2f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:52.932500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-997130bf-3ea7-414f-b24b-98cbae2e0d2f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:52.933288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-997130bf-3ea7-414f-b24b-98cbae2e0d2f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:52.933722 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-997130bf-3ea7-414f-b24b-98cbae2e0d2f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:53.061514 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-997130bf-3ea7-414f-b24b-98cbae2e0d2f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:53.069101 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-997130bf-3ea7-414f-b24b-98cbae2e0d2f tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1314 microversion: 2.1 time: 0.149110 Jun 23 22:53:53.069671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 534/1046] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:52 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:54.086570 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-746e6490-7eab-4e6b-840f-14577e7046c5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:54.087262 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-746e6490-7eab-4e6b-840f-14577e7046c5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:54.090354 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:54.092932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:54.095979 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-746e6490-7eab-4e6b-840f-14577e7046c5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:54.096434 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-746e6490-7eab-4e6b-840f-14577e7046c5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:54.097315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-746e6490-7eab-4e6b-840f-14577e7046c5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:54.097949 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-746e6490-7eab-4e6b-840f-14577e7046c5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:54.337106 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-746e6490-7eab-4e6b-840f-14577e7046c5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:54.346928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-746e6490-7eab-4e6b-840f-14577e7046c5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1498 microversion: 2.1 time: 0.264287 Jun 23 22:53:54.350397 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 513/1047] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:54 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1498 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:55.213607 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7ff74bf8-8ee3-4d59-9a0a-56b1076a5d86 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:55.214223 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7ff74bf8-8ee3-4d59-9a0a-56b1076a5d86 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:55.217321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:55.221411 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ff74bf8-8ee3-4d59-9a0a-56b1076a5d86 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:55.221795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ff74bf8-8ee3-4d59-9a0a-56b1076a5d86 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:55.222561 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ff74bf8-8ee3-4d59-9a0a-56b1076a5d86 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:55.222997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ff74bf8-8ee3-4d59-9a0a-56b1076a5d86 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:55.249660 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7ff74bf8-8ee3-4d59-9a0a-56b1076a5d86 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:53:55.528891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7ff74bf8-8ee3-4d59-9a0a-56b1076a5d86 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 204 len: 0 microversion: 2.1 time: 0.319468 Jun 23 22:53:55.529541 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 535/1048] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:53:55 2022] DELETE /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:53:55.537897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-eb786c83-6486-419a-9afa-1e3f2458a0a5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:55.538512 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-eb786c83-6486-419a-9afa-1e3f2458a0a5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:55.545412 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb786c83-6486-419a-9afa-1e3f2458a0a5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:55.545853 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb786c83-6486-419a-9afa-1e3f2458a0a5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:55.546616 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb786c83-6486-419a-9afa-1e3f2458a0a5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:55.547053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-eb786c83-6486-419a-9afa-1e3f2458a0a5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:55.678292 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-eb786c83-6486-419a-9afa-1e3f2458a0a5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:55.685872 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-eb786c83-6486-419a-9afa-1e3f2458a0a5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1504 microversion: 2.1 time: 0.151843 Jun 23 22:53:55.686431 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 514/1049] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:55 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:56.704825 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4c746db3-6a7b-4a84-a75a-35ecb490ba98 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:56.705558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4c746db3-6a7b-4a84-a75a-35ecb490ba98 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:56.712016 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c746db3-6a7b-4a84-a75a-35ecb490ba98 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:56.712469 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c746db3-6a7b-4a84-a75a-35ecb490ba98 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:56.713271 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c746db3-6a7b-4a84-a75a-35ecb490ba98 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:56.713699 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4c746db3-6a7b-4a84-a75a-35ecb490ba98 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:56.733131 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:56.847243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4c746db3-6a7b-4a84-a75a-35ecb490ba98 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:56.857260 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4c746db3-6a7b-4a84-a75a-35ecb490ba98 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1504 microversion: 2.1 time: 0.156193 Jun 23 22:53:56.857260 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 536/1050] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:56 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:57.450373 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-5a676ec6-159a-4baa-bd2c-1e4a9f0297a4 req-b6d3e3c0-e330-4a0e-9762-1ff7af8cc32e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b9e52f2-84db-45a9-9256-09005fdd9344", "name": "network-vif-deleted", "tag": "f2cc4f9b-a6e7-4636-b373-47327b099ade"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:57.458980 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5a676ec6-159a-4baa-bd2c-1e4a9f0297a4 req-b6d3e3c0-e330-4a0e-9762-1ff7af8cc32e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:57.459426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5a676ec6-159a-4baa-bd2c-1e4a9f0297a4 req-b6d3e3c0-e330-4a0e-9762-1ff7af8cc32e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:57.464004 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:53:57.473679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-5a676ec6-159a-4baa-bd2c-1e4a9f0297a4 req-b6d3e3c0-e330-4a0e-9762-1ff7af8cc32e service nova] Creating event network-vif-deleted:f2cc4f9b-a6e7-4636-b373-47327b099ade for instance 3b9e52f2-84db-45a9-9256-09005fdd9344 on hv-cinder-81322 Jun 23 22:53:57.479200 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-5a676ec6-159a-4baa-bd2c-1e4a9f0297a4 req-b6d3e3c0-e330-4a0e-9762-1ff7af8cc32e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033208 Jun 23 22:53:57.479825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 515/1051] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:53:57.873586 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:57.874192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:57.881294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:57.881771 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:57.882527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:57.882963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:57.916881 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:57.917323 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:57.917795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lazy-loading 'fault' on Instance uuid 3b9e52f2-84db-45a9-9256-09005fdd9344 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:53:57.958870 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:57.966238 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d7ee4d9e-dc08-4672-89d0-6bee42369021 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 200 len: 1304 microversion: 2.1 time: 0.097458 Jun 23 22:53:57.966787 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 537/1052] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:57 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:53:58.984831 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:58.985533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 3b9e52f2-84db-45a9-9256-09005fdd9344] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:58.992127 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:58.992600 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:58.993362 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:58.993801 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:59.007256 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] HTTP exception thrown: Instance 3b9e52f2-84db-45a9-9256-09005fdd9344 could not be found. Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Request method failure captured: Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 HTTP/1.1 Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO71RdTegAtzJxfxkoi159URAvANoDDO8-qVqri04hJtIZmE1lHGquHJt2yTcSamMPE-bJnQJwZVi28DyOBCml3rLkb6a-q6uGXpJSavPnHmaXmLfBLveA0f_te-FXcAJQqQr1dKEXZlxBoSpz4y4XkIjCvXxrqlbAAr5uJ3E-IBzD0 Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 7cee5e6784454293bc02e0e595d58b22 Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-VolumesActionsTest-2142236582 Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:53:59.008948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7cee5e6784454293bc02e0e595d58b22", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7cee5e6784454293bc02e0e595d58b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7cee5e6784454293bc02e0e595d58b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7cee5e6784454293bc02e0e595d58b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-VolumesActionsTest-2142236582 Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 7cee5e6784454293bc02e0e595d58b22 Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-VolumesActionsTest-2142236582 Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-VolumesActionsTest-2142236582-project Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 2dcf17b8ad9349458e3328ebc2984902 Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-VolumesActionsTest-2142236582-project Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 3b9e52f2-84db-45a9-9256-09005fdd9344 could not be found. Jun 23 22:53:59.010899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '3b9e52f2-84db-45a9-9256-09005fdd9344'} Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b9e52f2-84db-45a9-9256-09005fdd9344 could not be found. Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:53:59.011822 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b9e52f2-84db-45a9-9256-09005fdd9344 could not be found. Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b9e52f2-84db-45a9-9256-09005fdd9344 could not be found. Jun 23 22:53:59.013321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:53:59.016015 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Returning 404 to user: Instance 3b9e52f2-84db-45a9-9256-09005fdd9344 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:53:59.016899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-65ed8105-3817-4827-9b10-4582974d62f8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344" status: 404 len: 111 microversion: 2.1 time: 0.037331 Jun 23 22:53:59.017455 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 516/1053] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:58 2022] GET /compute/v2.1/servers/3b9e52f2-84db-45a9-9256-09005fdd9344 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:53:59.114700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-451892737", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "networks": [{"uuid": "8a74ee39-3743-4024-9b72-eae7e4ba12b3"}]}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:53:59.168343 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.network.neutron [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] validate_networks() for [('8a74ee39-3743-4024-9b72-eae7e4ba12b3', None, None, None, None, None)] {{(pid=124724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:53:59.523317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Flavor limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:53:59.523745 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Image limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:53:59.524252 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Flavor pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:53:59.524807 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Image pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:53:59.525138 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:53:59.533980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:59.534507 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:59.535319 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:53:59.535756 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:53:59.553341 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Getting quotas for project 7cee5e6784454293bc02e0e595d58b22. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:53:59.557247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Getting quotas for user 2dcf17b8ad9349458e3328ebc2984902 and project 7cee5e6784454293bc02e0e595d58b22. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:53:59.568441 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Going to run 1 instances... {{(pid=124724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:53:59.570723 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:53:59.739933 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c23497bd-532f-455f-ac4b-a2808b4a2f46 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629193 Jun 23 22:53:59.740569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 538/1054] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:53:59.750965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a775e48e-d0c2-41d4-9525-e504d6994652 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:53:59.752645 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a775e48e-d0c2-41d4-9525-e504d6994652 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:53:59.806276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a775e48e-d0c2-41d4-9525-e504d6994652 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:53:59.815295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a775e48e-d0c2-41d4-9525-e504d6994652 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1213 microversion: 2.1 time: 0.068453 Jun 23 22:53:59.815854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 517/1055] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:53:59 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:54:00.833062 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-75f51a98-94b7-4daa-8a0f-92d92603172b tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:00.833681 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-75f51a98-94b7-4daa-8a0f-92d92603172b tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:00.840565 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75f51a98-94b7-4daa-8a0f-92d92603172b tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:00.841043 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75f51a98-94b7-4daa-8a0f-92d92603172b tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:00.841813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75f51a98-94b7-4daa-8a0f-92d92603172b tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:00.842254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-75f51a98-94b7-4daa-8a0f-92d92603172b tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:00.915562 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-75f51a98-94b7-4daa-8a0f-92d92603172b tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:00.924396 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-75f51a98-94b7-4daa-8a0f-92d92603172b tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1217 microversion: 2.1 time: 0.095752 Jun 23 22:54:00.924984 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 539/1056] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:00 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:01.942919 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-69cdca51-e6a3-4a75-b8c6-e7804000f7bb tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:01.943517 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-69cdca51-e6a3-4a75-b8c6-e7804000f7bb tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:01.951541 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-69cdca51-e6a3-4a75-b8c6-e7804000f7bb tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:01.951991 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-69cdca51-e6a3-4a75-b8c6-e7804000f7bb tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:01.952789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-69cdca51-e6a3-4a75-b8c6-e7804000f7bb tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:01.953322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-69cdca51-e6a3-4a75-b8c6-e7804000f7bb tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:02.041888 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-69cdca51-e6a3-4a75-b8c6-e7804000f7bb tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:02.050649 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-69cdca51-e6a3-4a75-b8c6-e7804000f7bb tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1273 microversion: 2.1 time: 0.111736 Jun 23 22:54:02.051232 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 518/1057] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:01 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:03.068066 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ffc4d515-d60b-498b-92cf-712a9ed295d6 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:03.068710 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ffc4d515-d60b-498b-92cf-712a9ed295d6 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:03.077463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ffc4d515-d60b-498b-92cf-712a9ed295d6 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:03.077830 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ffc4d515-d60b-498b-92cf-712a9ed295d6 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:03.078620 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ffc4d515-d60b-498b-92cf-712a9ed295d6 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:03.080015 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ffc4d515-d60b-498b-92cf-712a9ed295d6 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:03.214023 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-ffc4d515-d60b-498b-92cf-712a9ed295d6 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:03.221635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ffc4d515-d60b-498b-92cf-712a9ed295d6 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1313 microversion: 2.1 time: 0.157619 Jun 23 22:54:03.225720 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 540/1058] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:03 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:03.612270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-fb082398-f833-48f7-afd6-16dab36bc4b4 req-3714d7e9-a251-467c-bdb4-192f4be85cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4b1e02-d197-443f-b2e4-35b33453df4d", "tag": "f5a742ff-6273-4ebb-aa44-b7d5ea022059"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:03.621812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-fb082398-f833-48f7-afd6-16dab36bc4b4 req-3714d7e9-a251-467c-bdb4-192f4be85cbe service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:03.623557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-fb082398-f833-48f7-afd6-16dab36bc4b4 req-3714d7e9-a251-467c-bdb4-192f4be85cbe service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:03.634215 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-fb082398-f833-48f7-afd6-16dab36bc4b4 req-3714d7e9-a251-467c-bdb4-192f4be85cbe service nova] Creating event network-changed:f5a742ff-6273-4ebb-aa44-b7d5ea022059 for instance 4b4b1e02-d197-443f-b2e4-35b33453df4d on hv-cinder-81322 Jun 23 22:54:03.639284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-fb082398-f833-48f7-afd6-16dab36bc4b4 req-3714d7e9-a251-467c-bdb4-192f4be85cbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030902 Jun 23 22:54:03.639908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 519/1059] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:54:04.240019 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8542d94c-6b10-4c64-81ff-ed811adf0e32 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:04.240730 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8542d94c-6b10-4c64-81ff-ed811adf0e32 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:04.247654 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8542d94c-6b10-4c64-81ff-ed811adf0e32 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:04.248110 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8542d94c-6b10-4c64-81ff-ed811adf0e32 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:04.249109 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8542d94c-6b10-4c64-81ff-ed811adf0e32 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:04.249713 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8542d94c-6b10-4c64-81ff-ed811adf0e32 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:04.382225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8542d94c-6b10-4c64-81ff-ed811adf0e32 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:04.390301 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8542d94c-6b10-4c64-81ff-ed811adf0e32 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1313 microversion: 2.1 time: 0.154148 Jun 23 22:54:04.391013 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 541/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:04 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:05.408862 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9151e2f5-6c61-40f5-a9dc-cd00473eee4e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:05.409564 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9151e2f5-6c61-40f5-a9dc-cd00473eee4e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:05.415933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9151e2f5-6c61-40f5-a9dc-cd00473eee4e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:05.416382 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9151e2f5-6c61-40f5-a9dc-cd00473eee4e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:05.417179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9151e2f5-6c61-40f5-a9dc-cd00473eee4e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:05.417613 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9151e2f5-6c61-40f5-a9dc-cd00473eee4e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:05.789823 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-9151e2f5-6c61-40f5-a9dc-cd00473eee4e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:05.798098 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9151e2f5-6c61-40f5-a9dc-cd00473eee4e tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1313 microversion: 2.1 time: 0.394367 Jun 23 22:54:05.798599 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 520/1061] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:05 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1313 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:06.815667 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-01c6ab61-5881-4980-95c2-92762edaefc5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:06.816282 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-01c6ab61-5881-4980-95c2-92762edaefc5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:06.818705 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:06.823703 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-01c6ab61-5881-4980-95c2-92762edaefc5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:06.825185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-01c6ab61-5881-4980-95c2-92762edaefc5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:06.826204 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-01c6ab61-5881-4980-95c2-92762edaefc5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:06.826686 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-01c6ab61-5881-4980-95c2-92762edaefc5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:06.961576 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-01c6ab61-5881-4980-95c2-92762edaefc5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:06.968979 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-01c6ab61-5881-4980-95c2-92762edaefc5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1313 microversion: 2.1 time: 0.157206 Jun 23 22:54:06.969539 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 542/1062] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:06 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:54:07.862380 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-01871f33-7af3-4314-b4fd-12c886137800 req-dbc021a4-1980-48f1-91c1-1bd565533879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4b1e02-d197-443f-b2e4-35b33453df4d", "name": "network-vif-plugged", "status": "completed", "tag": "f5a742ff-6273-4ebb-aa44-b7d5ea022059"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:07.871059 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-01871f33-7af3-4314-b4fd-12c886137800 req-dbc021a4-1980-48f1-91c1-1bd565533879 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:07.871595 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-01871f33-7af3-4314-b4fd-12c886137800 req-dbc021a4-1980-48f1-91c1-1bd565533879 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:07.883137 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-01871f33-7af3-4314-b4fd-12c886137800 req-dbc021a4-1980-48f1-91c1-1bd565533879 service nova] Creating event network-vif-plugged:f5a742ff-6273-4ebb-aa44-b7d5ea022059 for instance 4b4b1e02-d197-443f-b2e4-35b33453df4d on hv-cinder-81322 Jun 23 22:54:07.889078 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-01871f33-7af3-4314-b4fd-12c886137800 req-dbc021a4-1980-48f1-91c1-1bd565533879 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030074 Jun 23 22:54:07.893563 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 521/1063] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:54:07.986852 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-304a7e54-3a7b-429b-9f87-8b65cad30ef8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:07.987796 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-304a7e54-3a7b-429b-9f87-8b65cad30ef8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:07.994752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-304a7e54-3a7b-429b-9f87-8b65cad30ef8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:07.995209 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-304a7e54-3a7b-429b-9f87-8b65cad30ef8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:07.995982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-304a7e54-3a7b-429b-9f87-8b65cad30ef8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:07.996422 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-304a7e54-3a7b-429b-9f87-8b65cad30ef8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:08.141462 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-304a7e54-3a7b-429b-9f87-8b65cad30ef8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:08.149439 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-304a7e54-3a7b-429b-9f87-8b65cad30ef8 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1313 microversion: 2.1 time: 0.167477 Jun 23 22:54:08.149998 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 543/1064] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:07 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:09.167882 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6e64884a-63b4-493a-b716-9dba59cf3217 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:09.168597 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6e64884a-63b4-493a-b716-9dba59cf3217 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:09.175776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e64884a-63b4-493a-b716-9dba59cf3217 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:09.176260 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e64884a-63b4-493a-b716-9dba59cf3217 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:09.177082 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e64884a-63b4-493a-b716-9dba59cf3217 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:09.177517 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e64884a-63b4-493a-b716-9dba59cf3217 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:09.311484 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6e64884a-63b4-493a-b716-9dba59cf3217 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:09.319109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6e64884a-63b4-493a-b716-9dba59cf3217 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1313 microversion: 2.1 time: 0.155909 Jun 23 22:54:09.319671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 522/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:09 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:10.336242 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7ee57de2-0d56-425a-9464-11d8e66d880c tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:10.336893 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7ee57de2-0d56-425a-9464-11d8e66d880c tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:10.338882 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:10.339549 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:10.344766 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ee57de2-0d56-425a-9464-11d8e66d880c tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:10.344956 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ee57de2-0d56-425a-9464-11d8e66d880c tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:10.345729 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ee57de2-0d56-425a-9464-11d8e66d880c tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:10.346168 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ee57de2-0d56-425a-9464-11d8e66d880c tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:10.481243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7ee57de2-0d56-425a-9464-11d8e66d880c tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:10.488856 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7ee57de2-0d56-425a-9464-11d8e66d880c tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1498 microversion: 2.1 time: 0.156446 Jun 23 22:54:10.489405 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 544/1066] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:10 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:11.417830 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-910ec2b7-fc20-423f-b474-33b025e59bb5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:11.418366 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-910ec2b7-fc20-423f-b474-33b025e59bb5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:11.420324 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:11.425692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-910ec2b7-fc20-423f-b474-33b025e59bb5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:11.430350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-910ec2b7-fc20-423f-b474-33b025e59bb5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:11.430350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-910ec2b7-fc20-423f-b474-33b025e59bb5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:11.430350 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-910ec2b7-fc20-423f-b474-33b025e59bb5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:11.452864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-910ec2b7-fc20-423f-b474-33b025e59bb5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:54:11.642246 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:11.745463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-910ec2b7-fc20-423f-b474-33b025e59bb5 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 204 len: 0 microversion: 2.1 time: 0.331179 Jun 23 22:54:11.746074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 523/1067] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:54:11 2022] DELETE /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:54:11.754738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1d72716f-31b8-4ebb-94b5-e3a22817a6bd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:11.755445 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1d72716f-31b8-4ebb-94b5-e3a22817a6bd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:11.762067 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1d72716f-31b8-4ebb-94b5-e3a22817a6bd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:11.762522 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1d72716f-31b8-4ebb-94b5-e3a22817a6bd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:11.763284 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1d72716f-31b8-4ebb-94b5-e3a22817a6bd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:11.763723 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1d72716f-31b8-4ebb-94b5-e3a22817a6bd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:11.893671 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1d72716f-31b8-4ebb-94b5-e3a22817a6bd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:11.901244 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1d72716f-31b8-4ebb-94b5-e3a22817a6bd tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1504 microversion: 2.1 time: 0.150367 Jun 23 22:54:11.901803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 545/1068] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:11 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:12.918695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e2efa014-f861-4ffb-baf2-058a312b2024 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:12.919416 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e2efa014-f861-4ffb-baf2-058a312b2024 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:12.926914 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2efa014-f861-4ffb-baf2-058a312b2024 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:12.927357 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2efa014-f861-4ffb-baf2-058a312b2024 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:12.928277 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2efa014-f861-4ffb-baf2-058a312b2024 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:12.928741 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e2efa014-f861-4ffb-baf2-058a312b2024 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:13.056254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e2efa014-f861-4ffb-baf2-058a312b2024 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:13.064492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e2efa014-f861-4ffb-baf2-058a312b2024 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1504 microversion: 2.1 time: 0.149801 Jun 23 22:54:13.070280 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 524/1069] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:12 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:13.817459 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-98cd2643-8183-4cc2-b7c0-397f8d59a2e2 req-c086b83a-ccd7-4cc9-a2a7-d5e291d5542e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4b1e02-d197-443f-b2e4-35b33453df4d", "name": "network-vif-deleted", "tag": "f5a742ff-6273-4ebb-aa44-b7d5ea022059"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:13.825971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-98cd2643-8183-4cc2-b7c0-397f8d59a2e2 req-c086b83a-ccd7-4cc9-a2a7-d5e291d5542e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:13.827012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-98cd2643-8183-4cc2-b7c0-397f8d59a2e2 req-c086b83a-ccd7-4cc9-a2a7-d5e291d5542e service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:13.837930 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-98cd2643-8183-4cc2-b7c0-397f8d59a2e2 req-c086b83a-ccd7-4cc9-a2a7-d5e291d5542e service nova] Creating event network-vif-deleted:f5a742ff-6273-4ebb-aa44-b7d5ea022059 for instance 4b4b1e02-d197-443f-b2e4-35b33453df4d on hv-cinder-81322 Jun 23 22:54:13.843379 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-98cd2643-8183-4cc2-b7c0-397f8d59a2e2 req-c086b83a-ccd7-4cc9-a2a7-d5e291d5542e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029790 Jun 23 22:54:13.843949 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 546/1070] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:54:14.086514 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:14.087053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:14.093696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:14.094149 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:14.094915 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:14.095354 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:14.127169 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:14.127622 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:14.128062 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lazy-loading 'fault' on Instance uuid 4b4b1e02-d197-443f-b2e4-35b33453df4d {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:54:14.168111 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dcf17b8ad9349458e3328ebc2984902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cee5e6784454293bc02e0e595d58b22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:14.175821 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-2b93638e-1673-45b1-ab51-53d1fbb71259 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 200 len: 1303 microversion: 2.1 time: 0.093441 Jun 23 22:54:14.176378 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 525/1071] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:14 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:15.193118 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:15.193812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] [instance: 4b4b1e02-d197-443f-b2e4-35b33453df4d] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:15.200002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:15.200448 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:15.201227 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:15.201659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:15.215167 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] HTTP exception thrown: Instance 4b4b1e02-d197-443f-b2e4-35b33453df4d could not be found. Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Request method failure captured: Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d HTTP/1.1 Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO71RdTegAtzJxfxkoi159URAvANoDDO8-qVqri04hJtIZmE1lHGquHJt2yTcSamMPE-bJnQJwZVi28DyOBCml3rLkb6a-q6uGXpJSavPnHmaXmLfBLveA0f_te-FXcAJQqQr1dKEXZlxBoSpz4y4XkIjCvXxrqlbAAr5uJ3E-IBzD0 Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 7cee5e6784454293bc02e0e595d58b22 Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-VolumesActionsTest-2142236582 Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:54:15.216797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7cee5e6784454293bc02e0e595d58b22", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7cee5e6784454293bc02e0e595d58b22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7cee5e6784454293bc02e0e595d58b22"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7cee5e6784454293bc02e0e595d58b22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-VolumesActionsTest-2142236582 Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 7cee5e6784454293bc02e0e595d58b22 Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-VolumesActionsTest-2142236582 Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-VolumesActionsTest-2142236582-project Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 2dcf17b8ad9349458e3328ebc2984902 Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-VolumesActionsTest-2142236582-project Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 4b4b1e02-d197-443f-b2e4-35b33453df4d could not be found. Jun 23 22:54:15.218499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '4b4b1e02-d197-443f-b2e4-35b33453df4d'} Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b4b1e02-d197-443f-b2e4-35b33453df4d could not be found. Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:54:15.220219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b4b1e02-d197-443f-b2e4-35b33453df4d could not be found. Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b4b1e02-d197-443f-b2e4-35b33453df4d could not be found. Jun 23 22:54:15.221868 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:15.223355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] Returning 404 to user: Instance 4b4b1e02-d197-443f-b2e4-35b33453df4d could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:54:15.223355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-a464aaad-ca7f-4794-afa2-85e5ff372e42 tempest-VolumesActionsTest-2142236582 tempest-VolumesActionsTest-2142236582-project] 10.222.0.33 "GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d" status: 404 len: 111 microversion: 2.1 time: 0.029834 Jun 23 22:54:15.223355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 547/1072] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:15 2022] GET /compute/v2.1/servers/4b4b1e02-d197-443f-b2e4-35b33453df4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:54:34.568329 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-94ebd9bc-d0c7-4ab3-b4cd-59573c0f8e95 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:34.569949 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-94ebd9bc-d0c7-4ab3-b4cd-59573c0f8e95 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:34.572387 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:34.573260 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:34.579138 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94ebd9bc-d0c7-4ab3-b4cd-59573c0f8e95 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:34.579854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94ebd9bc-d0c7-4ab3-b4cd-59573c0f8e95 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:34.580921 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94ebd9bc-d0c7-4ab3-b4cd-59573c0f8e95 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:34.581820 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-94ebd9bc-d0c7-4ab3-b4cd-59573c0f8e95 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:34.630683 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-94ebd9bc-d0c7-4ab3-b4cd-59573c0f8e95 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066813 Jun 23 22:54:34.636279 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 526/1073] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:54:34 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:54:34.711513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-de93f163-f425-43e1-ad13-32b76752b966 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:34.711513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-de93f163-f425-43e1-ad13-32b76752b966 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:34.711513 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=11 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:34.712609 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=58 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:34.718309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de93f163-f425-43e1-ad13-32b76752b966 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:34.719519 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de93f163-f425-43e1-ad13-32b76752b966 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:34.720856 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de93f163-f425-43e1-ad13-32b76752b966 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:34.721508 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-de93f163-f425-43e1-ad13-32b76752b966 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:34.754037 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-de93f163-f425-43e1-ad13-32b76752b966 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:54:35.136611 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-de93f163-f425-43e1-ad13-32b76752b966 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 204 len: 0 microversion: 2.1 time: 0.435612 Jun 23 22:54:35.137569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 548/1074] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:54:34 2022] DELETE /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:54:35.146745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6540f0f0-a66a-4cae-9e3e-ebb4184c010e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:35.147830 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6540f0f0-a66a-4cae-9e3e-ebb4184c010e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:35.156040 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6540f0f0-a66a-4cae-9e3e-ebb4184c010e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:35.156823 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6540f0f0-a66a-4cae-9e3e-ebb4184c010e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:35.157942 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6540f0f0-a66a-4cae-9e3e-ebb4184c010e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:35.158568 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6540f0f0-a66a-4cae-9e3e-ebb4184c010e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:35.378173 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6540f0f0-a66a-4cae-9e3e-ebb4184c010e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:35.383272 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fcb4e025-4e98-48f3-a37a-6f0d20b9af71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:35.384163 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fcb4e025-4e98-48f3-a37a-6f0d20b9af71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:35.393491 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6540f0f0-a66a-4cae-9e3e-ebb4184c010e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.250392 Jun 23 22:54:35.405465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 527/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:35 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:35.410612 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fcb4e025-4e98-48f3-a37a-6f0d20b9af71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:35.411901 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fcb4e025-4e98-48f3-a37a-6f0d20b9af71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:35.413299 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-3759ec96-ed53-4b4a-978c-137b92bf2646 req-c62f70e2-b61d-43dd-b582-df53d2ee223d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d527872f-0d7a-40d9-8580-8b600f9faab0", "tag": "c99bb277-531f-4d18-9249-90e6d9db2e1b"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:35.413940 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fcb4e025-4e98-48f3-a37a-6f0d20b9af71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:35.414616 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fcb4e025-4e98-48f3-a37a-6f0d20b9af71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:35.425469 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3759ec96-ed53-4b4a-978c-137b92bf2646 req-c62f70e2-b61d-43dd-b582-df53d2ee223d service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:35.426115 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-3759ec96-ed53-4b4a-978c-137b92bf2646 req-c62f70e2-b61d-43dd-b582-df53d2ee223d service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:35.442965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-3759ec96-ed53-4b4a-978c-137b92bf2646 req-c62f70e2-b61d-43dd-b582-df53d2ee223d service nova] Creating event network-changed:c99bb277-531f-4d18-9249-90e6d9db2e1b for instance d527872f-0d7a-40d9-8580-8b600f9faab0 on hv-cinder-81322 Jun 23 22:54:35.449324 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-3759ec96-ed53-4b4a-978c-137b92bf2646 req-c62f70e2-b61d-43dd-b582-df53d2ee223d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039285 Jun 23 22:54:35.452536 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fcb4e025-4e98-48f3-a37a-6f0d20b9af71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:54:35.455196 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 528/1076] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:54:35.807660 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fcb4e025-4e98-48f3-a37a-6f0d20b9af71 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 204 len: 0 microversion: 2.1 time: 0.432266 Jun 23 22:54:35.809509 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 549/1077] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:54:35 2022] DELETE /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:54:35.819269 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d363cb4a-30ba-4510-9eb5-753212802302 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:35.820120 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d363cb4a-30ba-4510-9eb5-753212802302 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:35.826927 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d363cb4a-30ba-4510-9eb5-753212802302 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:35.829701 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d363cb4a-30ba-4510-9eb5-753212802302 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:35.830746 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d363cb4a-30ba-4510-9eb5-753212802302 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:35.831550 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d363cb4a-30ba-4510-9eb5-753212802302 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:36.036998 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d363cb4a-30ba-4510-9eb5-753212802302 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:36.047399 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d363cb4a-30ba-4510-9eb5-753212802302 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.232160 Jun 23 22:54:36.048275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 529/1078] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:35 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:36.417507 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2d0b3b25-6438-46a4-b4fd-d9310164607e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:36.418245 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2d0b3b25-6438-46a4-b4fd-d9310164607e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:36.427182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d0b3b25-6438-46a4-b4fd-d9310164607e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:36.427646 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d0b3b25-6438-46a4-b4fd-d9310164607e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:36.428439 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d0b3b25-6438-46a4-b4fd-d9310164607e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:36.431185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2d0b3b25-6438-46a4-b4fd-d9310164607e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:36.598028 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2d0b3b25-6438-46a4-b4fd-d9310164607e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:36.606983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2d0b3b25-6438-46a4-b4fd-d9310164607e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.198859 Jun 23 22:54:36.607564 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 550/1079] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:36 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:37.066844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a41222f2-f335-40a9-8de2-c731cf744e8b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:37.068321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a41222f2-f335-40a9-8de2-c731cf744e8b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:37.075205 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a41222f2-f335-40a9-8de2-c731cf744e8b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:37.075875 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a41222f2-f335-40a9-8de2-c731cf744e8b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:37.076842 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a41222f2-f335-40a9-8de2-c731cf744e8b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:37.077434 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a41222f2-f335-40a9-8de2-c731cf744e8b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:37.288974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a41222f2-f335-40a9-8de2-c731cf744e8b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:37.298433 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a41222f2-f335-40a9-8de2-c731cf744e8b tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.235673 Jun 23 22:54:37.301099 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 530/1080] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:37 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:37.625757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9f6d89d5-213a-4c4d-9546-e1411aa41d60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:37.626297 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9f6d89d5-213a-4c4d-9546-e1411aa41d60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:37.632820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f6d89d5-213a-4c4d-9546-e1411aa41d60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:37.633299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f6d89d5-213a-4c4d-9546-e1411aa41d60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:37.634065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f6d89d5-213a-4c4d-9546-e1411aa41d60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:37.634505 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9f6d89d5-213a-4c4d-9546-e1411aa41d60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:37.762608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9f6d89d5-213a-4c4d-9546-e1411aa41d60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:37.771097 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9f6d89d5-213a-4c4d-9546-e1411aa41d60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.149755 Jun 23 22:54:37.771659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 551/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:37 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:38.315442 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5f519d3c-a1c3-4a0e-9661-d44c894ace99 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:38.317096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5f519d3c-a1c3-4a0e-9661-d44c894ace99 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:38.324096 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5f519d3c-a1c3-4a0e-9661-d44c894ace99 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:38.327249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5f519d3c-a1c3-4a0e-9661-d44c894ace99 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:38.327249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5f519d3c-a1c3-4a0e-9661-d44c894ace99 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:38.327249 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5f519d3c-a1c3-4a0e-9661-d44c894ace99 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:38.458974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5f519d3c-a1c3-4a0e-9661-d44c894ace99 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:38.466039 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5f519d3c-a1c3-4a0e-9661-d44c894ace99 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.154393 Jun 23 22:54:38.466615 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 531/1082] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:38 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:38.788972 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-2cdf840b-341f-4cb8-8ec0-af4d54fecc32 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:38.789604 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-2cdf840b-341f-4cb8-8ec0-af4d54fecc32 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:38.795624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2cdf840b-341f-4cb8-8ec0-af4d54fecc32 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:38.796071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2cdf840b-341f-4cb8-8ec0-af4d54fecc32 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:38.796835 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2cdf840b-341f-4cb8-8ec0-af4d54fecc32 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:38.797317 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-2cdf840b-341f-4cb8-8ec0-af4d54fecc32 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:38.927098 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-2cdf840b-341f-4cb8-8ec0-af4d54fecc32 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:38.934703 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-2cdf840b-341f-4cb8-8ec0-af4d54fecc32 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.149656 Jun 23 22:54:38.935259 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 552/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:38 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:39.483277 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d636bde8-1ea5-4c9d-9d2f-f8e4c454df40 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:39.483885 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d636bde8-1ea5-4c9d-9d2f-f8e4c454df40 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:39.491363 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d636bde8-1ea5-4c9d-9d2f-f8e4c454df40 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:39.491813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d636bde8-1ea5-4c9d-9d2f-f8e4c454df40 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:39.492588 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d636bde8-1ea5-4c9d-9d2f-f8e4c454df40 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:39.493036 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d636bde8-1ea5-4c9d-9d2f-f8e4c454df40 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:39.631508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d636bde8-1ea5-4c9d-9d2f-f8e4c454df40 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:39.643295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d636bde8-1ea5-4c9d-9d2f-f8e4c454df40 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.163853 Jun 23 22:54:39.644083 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 532/1084] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:39 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:39.951772 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d96bae3d-d1ee-4b9c-82ca-fa04708c6296 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:39.952416 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d96bae3d-d1ee-4b9c-82ca-fa04708c6296 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:39.959231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d96bae3d-d1ee-4b9c-82ca-fa04708c6296 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:39.959684 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d96bae3d-d1ee-4b9c-82ca-fa04708c6296 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:39.960447 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d96bae3d-d1ee-4b9c-82ca-fa04708c6296 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:39.960923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d96bae3d-d1ee-4b9c-82ca-fa04708c6296 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:40.091023 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d96bae3d-d1ee-4b9c-82ca-fa04708c6296 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:40.101443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d96bae3d-d1ee-4b9c-82ca-fa04708c6296 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.151549 Jun 23 22:54:40.101443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 553/1085] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:39 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:40.665748 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f581217a-73fd-40e6-bd9b-b385392f479e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:40.666366 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f581217a-73fd-40e6-bd9b-b385392f479e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:40.672965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f581217a-73fd-40e6-bd9b-b385392f479e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:40.673419 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f581217a-73fd-40e6-bd9b-b385392f479e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:40.674244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f581217a-73fd-40e6-bd9b-b385392f479e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:40.674696 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-f581217a-73fd-40e6-bd9b-b385392f479e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:40.804033 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f581217a-73fd-40e6-bd9b-b385392f479e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:40.811949 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f581217a-73fd-40e6-bd9b-b385392f479e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.150076 Jun 23 22:54:40.812512 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 533/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:40 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:41.116384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6ea22a5a-356e-4604-8551-7bf711dddf6e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:41.117020 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6ea22a5a-356e-4604-8551-7bf711dddf6e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:41.125980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6ea22a5a-356e-4604-8551-7bf711dddf6e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:41.125980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6ea22a5a-356e-4604-8551-7bf711dddf6e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:41.125980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6ea22a5a-356e-4604-8551-7bf711dddf6e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:41.125980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6ea22a5a-356e-4604-8551-7bf711dddf6e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:41.260368 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6ea22a5a-356e-4604-8551-7bf711dddf6e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:41.268372 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6ea22a5a-356e-4604-8551-7bf711dddf6e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.155851 Jun 23 22:54:41.268897 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 554/1087] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:41 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:54:41.839246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-e788f817-b05e-4b3c-8777-8698b2b61d86 req-c044b937-1335-4e5b-93ce-c73dc7a5ae71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60601697-91f9-4db0-9d49-5fdd0ff5387f", "name": "network-vif-unplugged", "status": "completed", "tag": "6fd710ab-eef3-40db-a657-88d40e58e8a7"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:41.841201 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a07da154-7dba-496b-9511-89d70cebf0cd tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:41.847595 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a07da154-7dba-496b-9511-89d70cebf0cd tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:41.851231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-e788f817-b05e-4b3c-8777-8698b2b61d86 req-c044b937-1335-4e5b-93ce-c73dc7a5ae71 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:41.851904 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-e788f817-b05e-4b3c-8777-8698b2b61d86 req-c044b937-1335-4e5b-93ce-c73dc7a5ae71 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:41.854641 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07da154-7dba-496b-9511-89d70cebf0cd tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:41.855308 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07da154-7dba-496b-9511-89d70cebf0cd tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:41.856086 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07da154-7dba-496b-9511-89d70cebf0cd tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:41.856759 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a07da154-7dba-496b-9511-89d70cebf0cd tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:41.866717 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-e788f817-b05e-4b3c-8777-8698b2b61d86 req-c044b937-1335-4e5b-93ce-c73dc7a5ae71 service nova] Creating event network-vif-unplugged:6fd710ab-eef3-40db-a657-88d40e58e8a7 for instance 60601697-91f9-4db0-9d49-5fdd0ff5387f on hv-cinder-81322 Jun 23 22:54:41.872365 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-e788f817-b05e-4b3c-8777-8698b2b61d86 req-c044b937-1335-4e5b-93ce-c73dc7a5ae71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036546 Jun 23 22:54:41.873364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 555/1088] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:54:42.042642 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a07da154-7dba-496b-9511-89d70cebf0cd tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:42.050543 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a07da154-7dba-496b-9511-89d70cebf0cd tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.219052 Jun 23 22:54:42.051723 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 534/1089] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:41 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:42.292219 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-00f78499-8336-4b3e-abd2-4ccedaa27e3a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:42.293021 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-00f78499-8336-4b3e-abd2-4ccedaa27e3a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:42.303991 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-00f78499-8336-4b3e-abd2-4ccedaa27e3a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:42.303991 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-00f78499-8336-4b3e-abd2-4ccedaa27e3a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:42.303991 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-00f78499-8336-4b3e-abd2-4ccedaa27e3a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:42.303991 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-00f78499-8336-4b3e-abd2-4ccedaa27e3a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:42.476911 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-00f78499-8336-4b3e-abd2-4ccedaa27e3a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:42.485076 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-00f78499-8336-4b3e-abd2-4ccedaa27e3a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.203065 Jun 23 22:54:42.485870 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 556/1090] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:42 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:43.067929 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ebe6302d-411c-4bb5-bbec-ea8c1ea8b240 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:43.069216 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ebe6302d-411c-4bb5-bbec-ea8c1ea8b240 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:43.075983 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ebe6302d-411c-4bb5-bbec-ea8c1ea8b240 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:43.076436 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ebe6302d-411c-4bb5-bbec-ea8c1ea8b240 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:43.077440 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ebe6302d-411c-4bb5-bbec-ea8c1ea8b240 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:43.077911 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ebe6302d-411c-4bb5-bbec-ea8c1ea8b240 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:43.219415 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ebe6302d-411c-4bb5-bbec-ea8c1ea8b240 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:43.227316 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ebe6302d-411c-4bb5-bbec-ea8c1ea8b240 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.163779 Jun 23 22:54:43.227882 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 535/1091] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:43 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:43.502760 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6266db94-7bc8-4eb3-80e5-e20b276302bc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:43.503481 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6266db94-7bc8-4eb3-80e5-e20b276302bc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:43.510630 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6266db94-7bc8-4eb3-80e5-e20b276302bc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:43.511084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6266db94-7bc8-4eb3-80e5-e20b276302bc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:43.511871 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6266db94-7bc8-4eb3-80e5-e20b276302bc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:43.512311 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6266db94-7bc8-4eb3-80e5-e20b276302bc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:43.652353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6266db94-7bc8-4eb3-80e5-e20b276302bc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:43.661054 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6266db94-7bc8-4eb3-80e5-e20b276302bc tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.162785 Jun 23 22:54:43.661648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 557/1092] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:43 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:43.886672 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-5f7e5429-23b6-4807-9f92-dac542577e5f req-8c6ca3d7-c823-4ef0-ae8f-a612b3e8bafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527872f-0d7a-40d9-8580-8b600f9faab0", "name": "network-vif-unplugged", "status": "completed", "tag": "c99bb277-531f-4d18-9249-90e6d9db2e1b"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:43.895627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5f7e5429-23b6-4807-9f92-dac542577e5f req-8c6ca3d7-c823-4ef0-ae8f-a612b3e8bafa service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:43.896062 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-5f7e5429-23b6-4807-9f92-dac542577e5f req-8c6ca3d7-c823-4ef0-ae8f-a612b3e8bafa service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:43.906648 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-5f7e5429-23b6-4807-9f92-dac542577e5f req-8c6ca3d7-c823-4ef0-ae8f-a612b3e8bafa service nova] Creating event network-vif-unplugged:c99bb277-531f-4d18-9249-90e6d9db2e1b for instance d527872f-0d7a-40d9-8580-8b600f9faab0 on hv-cinder-81322 Jun 23 22:54:43.911613 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-5f7e5429-23b6-4807-9f92-dac542577e5f req-8c6ca3d7-c823-4ef0-ae8f-a612b3e8bafa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028595 Jun 23 22:54:43.912161 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 536/1093] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:54:44.244108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-046ac7c9-28fc-40d9-a498-d9e731b674b9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:44.244778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-046ac7c9-28fc-40d9-a498-d9e731b674b9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:44.250802 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-046ac7c9-28fc-40d9-a498-d9e731b674b9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:44.251247 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-046ac7c9-28fc-40d9-a498-d9e731b674b9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:44.252700 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-046ac7c9-28fc-40d9-a498-d9e731b674b9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:44.253171 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-046ac7c9-28fc-40d9-a498-d9e731b674b9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:44.378487 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-046ac7c9-28fc-40d9-a498-d9e731b674b9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:44.385987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-046ac7c9-28fc-40d9-a498-d9e731b674b9 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.145728 Jun 23 22:54:44.386541 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 558/1094] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:44 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:44.680308 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3daaab33-44be-4cd9-912a-478f16372a44 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:44.680959 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3daaab33-44be-4cd9-912a-478f16372a44 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:44.687183 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3daaab33-44be-4cd9-912a-478f16372a44 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:44.687631 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3daaab33-44be-4cd9-912a-478f16372a44 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:44.688388 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3daaab33-44be-4cd9-912a-478f16372a44 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:44.688854 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3daaab33-44be-4cd9-912a-478f16372a44 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:44.821521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3daaab33-44be-4cd9-912a-478f16372a44 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:44.828885 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3daaab33-44be-4cd9-912a-478f16372a44 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.153437 Jun 23 22:54:44.829472 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 537/1095] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:44 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:45.402356 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7c996d83-5125-4652-ab93-35ba28f18843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:45.402899 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7c996d83-5125-4652-ab93-35ba28f18843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:45.409861 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7c996d83-5125-4652-ab93-35ba28f18843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:45.410311 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7c996d83-5125-4652-ab93-35ba28f18843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:45.411067 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7c996d83-5125-4652-ab93-35ba28f18843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:45.411505 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7c996d83-5125-4652-ab93-35ba28f18843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:45.545387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7c996d83-5125-4652-ab93-35ba28f18843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:45.552997 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7c996d83-5125-4652-ab93-35ba28f18843 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.154646 Jun 23 22:54:45.553556 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 559/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:45 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:45.846222 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-28d53fdf-0491-49d4-9517-7b7a706bee5e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:45.846837 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-28d53fdf-0491-49d4-9517-7b7a706bee5e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:45.853793 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28d53fdf-0491-49d4-9517-7b7a706bee5e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:45.854248 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28d53fdf-0491-49d4-9517-7b7a706bee5e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:45.855000 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28d53fdf-0491-49d4-9517-7b7a706bee5e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:45.855432 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28d53fdf-0491-49d4-9517-7b7a706bee5e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:45.983525 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-28d53fdf-0491-49d4-9517-7b7a706bee5e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:45.991603 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-28d53fdf-0491-49d4-9517-7b7a706bee5e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.149397 Jun 23 22:54:45.992157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 538/1097] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:45 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:46.570400 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-44ef65c5-a788-425a-bf74-0803b983f2db tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:46.571062 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-44ef65c5-a788-425a-bf74-0803b983f2db tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:46.577788 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-44ef65c5-a788-425a-bf74-0803b983f2db tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:46.578237 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-44ef65c5-a788-425a-bf74-0803b983f2db tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:46.579004 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-44ef65c5-a788-425a-bf74-0803b983f2db tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:46.579434 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-44ef65c5-a788-425a-bf74-0803b983f2db tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:46.711087 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-44ef65c5-a788-425a-bf74-0803b983f2db tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:46.718518 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-44ef65c5-a788-425a-bf74-0803b983f2db tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1577 microversion: 2.1 time: 0.152020 Jun 23 22:54:46.719075 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 560/1098] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:46 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:47.008601 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6da88235-d8f4-46b3-9532-60a479d4eea4 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:47.009367 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6da88235-d8f4-46b3-9532-60a479d4eea4 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:47.016898 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6da88235-d8f4-46b3-9532-60a479d4eea4 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:47.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6da88235-d8f4-46b3-9532-60a479d4eea4 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:47.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6da88235-d8f4-46b3-9532-60a479d4eea4 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:47.020996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6da88235-d8f4-46b3-9532-60a479d4eea4 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:47.334287 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6da88235-d8f4-46b3-9532-60a479d4eea4 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:47.343204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6da88235-d8f4-46b3-9532-60a479d4eea4 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1674 microversion: 2.1 time: 0.338540 Jun 23 22:54:47.350247 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 539/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:47 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1674 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:47.655093 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-d81857f1-6284-4a98-8867-6ff1426ffc8c req-2dcec5b6-f40f-4935-b53a-5c3df9a47381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d527872f-0d7a-40d9-8580-8b600f9faab0", "name": "network-vif-deleted", "tag": "c99bb277-531f-4d18-9249-90e6d9db2e1b"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:47.669730 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-d81857f1-6284-4a98-8867-6ff1426ffc8c req-2dcec5b6-f40f-4935-b53a-5c3df9a47381 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:47.670637 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-d81857f1-6284-4a98-8867-6ff1426ffc8c req-2dcec5b6-f40f-4935-b53a-5c3df9a47381 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:47.685782 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-d81857f1-6284-4a98-8867-6ff1426ffc8c req-2dcec5b6-f40f-4935-b53a-5c3df9a47381 service nova] Creating event network-vif-deleted:c99bb277-531f-4d18-9249-90e6d9db2e1b for instance d527872f-0d7a-40d9-8580-8b600f9faab0 on hv-cinder-81322 Jun 23 22:54:47.691755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-d81857f1-6284-4a98-8867-6ff1426ffc8c req-2dcec5b6-f40f-4935-b53a-5c3df9a47381 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044896 Jun 23 22:54:47.692931 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 561/1100] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:54:47.737653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-b041ee11-ad74-4cb2-ae57-13653f791edf tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:47.738305 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-b041ee11-ad74-4cb2-ae57-13653f791edf tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:47.745426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b041ee11-ad74-4cb2-ae57-13653f791edf tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:47.745876 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b041ee11-ad74-4cb2-ae57-13653f791edf tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:47.752218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b041ee11-ad74-4cb2-ae57-13653f791edf tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:47.752218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-b041ee11-ad74-4cb2-ae57-13653f791edf tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:47.822553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-b041ee11-ad74-4cb2-ae57-13653f791edf tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:47.833462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-b041ee11-ad74-4cb2-ae57-13653f791edf tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1391 microversion: 2.1 time: 0.100621 Jun 23 22:54:47.834043 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 540/1101] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:47 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1391 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:48.362285 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:48.363236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:48.376485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:48.381351 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:48.382447 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:48.382832 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:48.413072 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:48.428310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:48.428809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:48.429261 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lazy-loading 'fault' on Instance uuid 60601697-91f9-4db0-9d49-5fdd0ff5387f {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:54:48.476730 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:48.485589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7e7dea96-62eb-4f75-bd1b-ad3472920deb tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 200 len: 1327 microversion: 2.1 time: 0.129353 Jun 23 22:54:48.486367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 562/1102] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:48 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 1327 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:48.851367 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:48.851972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:48.860428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:48.860428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:48.860428 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:48.860807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:48.897495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:48.897954 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:48.898415 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lazy-loading 'fault' on Instance uuid d527872f-0d7a-40d9-8580-8b600f9faab0 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:54:48.941232 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:48.949394 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-0c88cafd-7690-49f8-a25e-b1a2446db40f tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 200 len: 1230 microversion: 2.1 time: 0.101958 Jun 23 22:54:48.949756 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 541/1103] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:48 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:49.513209 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:49.514669 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:49.522078 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:49.522557 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:49.523328 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:49.523769 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:49.537455 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] HTTP exception thrown: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Request method failure captured: Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f HTTP/1.1 Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO5kSAC1p1AsJQTpi-EXqQnUj5baXouRWfVr43sjMqIJi0rMvS7iAeGdd2Xqm_vS2KpIbYOnoHbttNEwnxphbWhRKwqNnjOsKConqQhqQd9RD-35XZu1Rz_Hm0BhkJma6aoTwXLBnVfC3hFHo3ZiCaCJZZ7f0jouvuDWuqoTwexCG5o Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:54:49.539159 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73d61a582ec24f99aaf018e55f1f049b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 92ce6158277146228cb13194e9d7b04b Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:54:49.540894 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '60601697-91f9-4db0-9d49-5fdd0ff5387f'} Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:54:49.541754 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:54:49.543064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.544235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Returning 404 to user: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:54:49.544235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7e8746e6-b41d-4853-aaec-9068659575ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 404 len: 111 microversion: 2.1 time: 0.031702 Jun 23 22:54:49.544235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 563/1104] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:49 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:54:49.550353 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fe499552-e6a9-4f99-a652-0a31044ace98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '.version_select at 0x7fbbcaa8e670>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:49.656506 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fe499552-e6a9-4f99-a652-0a31044ace98 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-700888045" status: 202 len: 0 microversion: 2.1 time: 0.110615 Jun 23 22:54:49.657239 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 542/1105] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 23 22:54:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-700888045 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:54:49.710463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-e21e565b-3703-4842-8527-9ac73ce50479 req-1df08984-2d38-4d95-b450-d1bf89bd7d26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60601697-91f9-4db0-9d49-5fdd0ff5387f", "name": "network-vif-deleted", "tag": "6fd710ab-eef3-40db-a657-88d40e58e8a7"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:49.719067 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-e21e565b-3703-4842-8527-9ac73ce50479 req-1df08984-2d38-4d95-b450-d1bf89bd7d26 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:49.719518 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-e21e565b-3703-4842-8527-9ac73ce50479 req-1df08984-2d38-4d95-b450-d1bf89bd7d26 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:49.731584 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-e21e565b-3703-4842-8527-9ac73ce50479 req-1df08984-2d38-4d95-b450-d1bf89bd7d26 service nova] Creating event network-vif-deleted:6fd710ab-eef3-40db-a657-88d40e58e8a7 for instance 60601697-91f9-4db0-9d49-5fdd0ff5387f on hv-cinder-81322 Jun 23 22:54:49.737652 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-e21e565b-3703-4842-8527-9ac73ce50479 req-1df08984-2d38-4d95-b450-d1bf89bd7d26 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031809 Jun 23 22:54:49.738385 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 564/1106] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:54:49.966344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:49.966960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: d527872f-0d7a-40d9-8580-8b600f9faab0] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:49.973498 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:49.973948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:49.974699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:49.975130 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:49.989554 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] HTTP exception thrown: Instance d527872f-0d7a-40d9-8580-8b600f9faab0 could not be found. Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Request method failure captured: Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 HTTP/1.1 Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO1Ifp4oILoHmPJSineDOmAtLsgWRSOxMJ8-GnSpfMX2-mQ9jiEAHf4gkqYsvbpjrcgsSfkV7OirX1iDTOIjn-1DNEZDVbqq-5DKX-vZejyeOSyP7BeMynoGED9t5rf3S3Ur1s_rA637CbFjJX0fUbsR2F2mrsEWNwaDP85v3nR6isA Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:54:49.991198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6fdc472916934fac985e88fb6a61290b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 84a5fb262284400591cf29dd13771ee7 Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance d527872f-0d7a-40d9-8580-8b600f9faab0 could not be found. Jun 23 22:54:49.992910 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': 'd527872f-0d7a-40d9-8580-8b600f9faab0'} Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d527872f-0d7a-40d9-8580-8b600f9faab0 could not be found. Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:54:49.994192 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d527872f-0d7a-40d9-8580-8b600f9faab0 could not be found. Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d527872f-0d7a-40d9-8580-8b600f9faab0 could not be found. Jun 23 22:54:49.995782 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:49.998465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Returning 404 to user: Instance d527872f-0d7a-40d9-8580-8b600f9faab0 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:54:49.998465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-34f47967-5ff8-41d5-8486-f5dcf970a002 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0" status: 404 len: 111 microversion: 2.1 time: 0.030593 Jun 23 22:54:49.998465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 543/1107] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:49 2022] GET /compute/v2.1/servers/d527872f-0d7a-40d9-8580-8b600f9faab0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:54:50.434667 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-435b0849-3750-48a0-917a-40a8f2d3c630 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'create', calling method: .version_select at 0x7fbbca39ac10>, body: {"keypair": {"name": "tempest-keypair-424624625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFPn6ko5QORW5FutsZWN3GsF+RqN5DuXYlwu+lA3k7pK17ulcwMgT/giW8j0SW1odLIIwzpj4CpPpGKpHQAMYmHg1NkIgsy6/3oaBeXHC5s8Qf8+OosMKPxtbobSsHaEA=="}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:50.448724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-435b0849-3750-48a0-917a-40a8f2d3c630 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Getting quotas for project 73d61a582ec24f99aaf018e55f1f049b. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:54:50.452511 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-435b0849-3750-48a0-917a-40a8f2d3c630 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Getting quotas for user 92ce6158277146228cb13194e9d7b04b and project 73d61a582ec24f99aaf018e55f1f049b. Resources: {'key_pairs'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:54:50.536893 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-435b0849-3750-48a0-917a-40a8f2d3c630 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.106731 Jun 23 22:54:50.537563 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 565/1108] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:54:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:54:53.313663 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-485443454", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b290ecdc-1395-4ffa-9481-d98d01d37dc3"}], "security_groups": [{"name": "tempest-securitygroup--2024340175"}], "key_name": "tempest-keypair-424624625", "user_data": "}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:53.420640 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] validate_networks() for [('b290ecdc-1395-4ffa-9481-d98d01d37dc3', None, None, None, None, None)] {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:54:53.649623 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5732b1b8-85a0-40ec-ab05-8d53973274e3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:53.650246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5732b1b8-85a0-40ec-ab05-8d53973274e3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:53.656778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5732b1b8-85a0-40ec-ab05-8d53973274e3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:53.657235 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5732b1b8-85a0-40ec-ab05-8d53973274e3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:53.658006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5732b1b8-85a0-40ec-ab05-8d53973274e3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:53.658447 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5732b1b8-85a0-40ec-ab05-8d53973274e3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:53.688277 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5732b1b8-85a0-40ec-ab05-8d53973274e3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Going to try to terminate instance {{(pid=124724) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:54:53.822862 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:54:53.823284 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:54:53.823758 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:54:53.824163 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:54:53.824585 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:54:53.834245 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:53.834695 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:53.835487 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:53.835918 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:53.858840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Getting quotas for project 73d61a582ec24f99aaf018e55f1f049b. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:54:53.864404 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Getting quotas for user 92ce6158277146228cb13194e9d7b04b and project 73d61a582ec24f99aaf018e55f1f049b. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:54:53.875885 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:54:53.878244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:54:53.952316 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5732b1b8-85a0-40ec-ab05-8d53973274e3 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 204 len: 0 microversion: 2.1 time: 0.307418 Jun 23 22:54:53.952940 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 566/1109] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:54:53 2022] DELETE /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:54:53.960983 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-8822e5b2-3489-49a4-99e4-66532b95aff7 req-206786ba-0042-4874-a7ff-396b5ba56e2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dc6a308-2725-417e-8596-d39f57306af5", "tag": "407cf8de-21c5-4a4d-8db2-9d64ac13fb20"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:53.973085 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-8822e5b2-3489-49a4-99e4-66532b95aff7 req-206786ba-0042-4874-a7ff-396b5ba56e2c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:53.973532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-8822e5b2-3489-49a4-99e4-66532b95aff7 req-206786ba-0042-4874-a7ff-396b5ba56e2c service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:53.988331 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-8822e5b2-3489-49a4-99e4-66532b95aff7 req-206786ba-0042-4874-a7ff-396b5ba56e2c service nova] Creating event network-changed:407cf8de-21c5-4a4d-8db2-9d64ac13fb20 for instance 5dc6a308-2725-417e-8596-d39f57306af5 on hv-cinder-81322 Jun 23 22:54:53.993724 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-8822e5b2-3489-49a4-99e4-66532b95aff7 req-206786ba-0042-4874-a7ff-396b5ba56e2c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039461 Jun 23 22:54:53.994270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-82bf2300-1c90-40e2-8d15-09bceb1deef0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684707 Jun 23 22:54:53.995737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 544/1110] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:54:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:54:53.996053 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 567/1111] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:54:54.008246 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-57b4327a-90a9-40de-b1fb-3bdd385adc3e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:54.009352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-59a8359d-5ec0-4fa6-b147-1a33e420763e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:54.010044 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-59a8359d-5ec0-4fa6-b147-1a33e420763e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:54.011991 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-57b4327a-90a9-40de-b1fb-3bdd385adc3e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:54.021710 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59a8359d-5ec0-4fa6-b147-1a33e420763e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:54.022465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59a8359d-5ec0-4fa6-b147-1a33e420763e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:54.023465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59a8359d-5ec0-4fa6-b147-1a33e420763e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:54.024116 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-59a8359d-5ec0-4fa6-b147-1a33e420763e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:54.083462 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-57b4327a-90a9-40de-b1fb-3bdd385adc3e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:54.090728 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-57b4327a-90a9-40de-b1fb-3bdd385adc3e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1236 microversion: 2.1 time: 0.088444 Jun 23 22:54:54.091625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 568/1112] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:54 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1236 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:54:54.214743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-59a8359d-5ec0-4fa6-b147-1a33e420763e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:54.219051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=100 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:54:54.226737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-59a8359d-5ec0-4fa6-b147-1a33e420763e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1579 microversion: 2.1 time: 0.228868 Jun 23 22:54:54.227330 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 545/1113] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:53 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1579 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:55.111557 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-396ebfaf-fc98-49bb-820d-8da031b3c3c6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:55.112899 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-396ebfaf-fc98-49bb-820d-8da031b3c3c6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:55.127092 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-396ebfaf-fc98-49bb-820d-8da031b3c3c6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:55.127887 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-396ebfaf-fc98-49bb-820d-8da031b3c3c6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:55.129270 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-396ebfaf-fc98-49bb-820d-8da031b3c3c6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:55.129880 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-396ebfaf-fc98-49bb-820d-8da031b3c3c6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:55.199044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-396ebfaf-fc98-49bb-820d-8da031b3c3c6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:55.211145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-396ebfaf-fc98-49bb-820d-8da031b3c3c6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1240 microversion: 2.1 time: 0.107051 Jun 23 22:54:55.211706 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 569/1114] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:55 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:55.245747 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3d234c5d-0e08-4bcd-9c1e-846684995282 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:55.246356 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3d234c5d-0e08-4bcd-9c1e-846684995282 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:55.253227 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d234c5d-0e08-4bcd-9c1e-846684995282 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:55.253699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d234c5d-0e08-4bcd-9c1e-846684995282 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:55.256136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d234c5d-0e08-4bcd-9c1e-846684995282 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:55.256136 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d234c5d-0e08-4bcd-9c1e-846684995282 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:55.398867 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3d234c5d-0e08-4bcd-9c1e-846684995282 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:55.406450 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3d234c5d-0e08-4bcd-9c1e-846684995282 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1579 microversion: 2.1 time: 0.165249 Jun 23 22:54:55.407365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 546/1115] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:55 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:56.229672 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-465577ae-c74d-47a6-982a-67e5c255bc7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:56.230892 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-465577ae-c74d-47a6-982a-67e5c255bc7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:56.238079 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-465577ae-c74d-47a6-982a-67e5c255bc7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:56.238532 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-465577ae-c74d-47a6-982a-67e5c255bc7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:56.239305 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-465577ae-c74d-47a6-982a-67e5c255bc7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:56.239917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-465577ae-c74d-47a6-982a-67e5c255bc7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:56.320810 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-465577ae-c74d-47a6-982a-67e5c255bc7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:56.328569 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-465577ae-c74d-47a6-982a-67e5c255bc7a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1296 microversion: 2.1 time: 0.103145 Jun 23 22:54:56.329153 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 570/1116] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:56 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1296 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:56.423844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-68f0b8bf-de0a-41b1-bba3-62ccc4054e1e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:56.424473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-68f0b8bf-de0a-41b1-bba3-62ccc4054e1e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:56.432100 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68f0b8bf-de0a-41b1-bba3-62ccc4054e1e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:56.432549 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68f0b8bf-de0a-41b1-bba3-62ccc4054e1e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:56.434155 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68f0b8bf-de0a-41b1-bba3-62ccc4054e1e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:56.438560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-68f0b8bf-de0a-41b1-bba3-62ccc4054e1e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:56.562743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-68f0b8bf-de0a-41b1-bba3-62ccc4054e1e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:56.571539 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-68f0b8bf-de0a-41b1-bba3-62ccc4054e1e tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1392 microversion: 2.1 time: 0.151977 Jun 23 22:54:56.572028 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 547/1117] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:56 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:56.615145 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-ecaa2864-965e-4450-93d9-7fba3f54ea01 req-014e6e1a-f3cb-451a-8454-1a6b6cb5ebac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dc6a308-2725-417e-8596-d39f57306af5", "name": "network-vif-deleted", "tag": "407cf8de-21c5-4a4d-8db2-9d64ac13fb20"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:56.623232 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-ecaa2864-965e-4450-93d9-7fba3f54ea01 req-014e6e1a-f3cb-451a-8454-1a6b6cb5ebac service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:56.627618 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-ecaa2864-965e-4450-93d9-7fba3f54ea01 req-014e6e1a-f3cb-451a-8454-1a6b6cb5ebac service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:56.635509 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-ecaa2864-965e-4450-93d9-7fba3f54ea01 req-014e6e1a-f3cb-451a-8454-1a6b6cb5ebac service nova] Creating event network-vif-deleted:407cf8de-21c5-4a4d-8db2-9d64ac13fb20 for instance 5dc6a308-2725-417e-8596-d39f57306af5 on hv-cinder-81322 Jun 23 22:54:56.640982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-ecaa2864-965e-4450-93d9-7fba3f54ea01 req-014e6e1a-f3cb-451a-8454-1a6b6cb5ebac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029901 Jun 23 22:54:56.641679 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 571/1118] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:54:57.346364 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1255343b-fab6-43ea-981a-172a35347260 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:57.347395 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1255343b-fab6-43ea-981a-172a35347260 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:57.354189 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1255343b-fab6-43ea-981a-172a35347260 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:57.354793 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1255343b-fab6-43ea-981a-172a35347260 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:57.355792 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1255343b-fab6-43ea-981a-172a35347260 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:57.356529 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1255343b-fab6-43ea-981a-172a35347260 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:57.504523 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1255343b-fab6-43ea-981a-172a35347260 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:57.512432 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1255343b-fab6-43ea-981a-172a35347260 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1362 microversion: 2.1 time: 0.170028 Jun 23 22:54:57.517317 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 548/1119] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:57 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:57.589266 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:57.589976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:57.597265 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:57.598361 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:57.599383 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:57.599831 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:57.631986 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:57.632355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:57.632958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lazy-loading 'fault' on Instance uuid 5dc6a308-2725-417e-8596-d39f57306af5 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:54:57.675800 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a5fb262284400591cf29dd13771ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fdc472916934fac985e88fb6a61290b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:57.683893 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-81f36c02-9b38-4c18-89c2-16290e5981fe tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 200 len: 1230 microversion: 2.1 time: 0.099254 Jun 23 22:54:57.684514 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 572/1120] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:57 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:58.529401 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1deb5d91-fe16-4feb-8e75-0b9dc4ae3ce6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:58.530023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1deb5d91-fe16-4feb-8e75-0b9dc4ae3ce6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:58.538626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1deb5d91-fe16-4feb-8e75-0b9dc4ae3ce6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:58.544254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1deb5d91-fe16-4feb-8e75-0b9dc4ae3ce6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:58.544254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1deb5d91-fe16-4feb-8e75-0b9dc4ae3ce6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:58.544254 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1deb5d91-fe16-4feb-8e75-0b9dc4ae3ce6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:58.658533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-a32a9610-e5fa-47da-ab36-6f572442be31 req-3a3a93e3-2b48-44de-8807-c04c30b5b169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d96a6eb-9a16-45e0-9398-11b2c47e05f2", "tag": "14d6421d-98b1-41b1-9d9c-46ba8373264e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:54:58.667622 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-a32a9610-e5fa-47da-ab36-6f572442be31 req-3a3a93e3-2b48-44de-8807-c04c30b5b169 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:58.668065 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-a32a9610-e5fa-47da-ab36-6f572442be31 req-3a3a93e3-2b48-44de-8807-c04c30b5b169 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:58.679733 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-a32a9610-e5fa-47da-ab36-6f572442be31 req-3a3a93e3-2b48-44de-8807-c04c30b5b169 service nova] Creating event network-changed:14d6421d-98b1-41b1-9d9c-46ba8373264e for instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 on hv-cinder-81322 Jun 23 22:54:58.684493 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-a32a9610-e5fa-47da-ab36-6f572442be31 req-3a3a93e3-2b48-44de-8807-c04c30b5b169 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030716 Jun 23 22:54:58.685265 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 573/1121] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:54:58.702530 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:58.703217 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 5dc6a308-2725-417e-8596-d39f57306af5] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:58.709971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:58.710424 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:58.711193 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:58.711632 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:58.726132 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] HTTP exception thrown: Instance 5dc6a308-2725-417e-8596-d39f57306af5 could not be found. Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Request method failure captured: Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 HTTP/1.1 Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO1Ifp4oILoHmPJSineDOmAtLsgWRSOxMJ8-GnSpfMX2-mQ9jiEAHf4gkqYsvbpjrcgsSfkV7OirX1iDTOIjn-1DNEZDVbqq-5DKX-vZejyeOSyP7BeMynoGED9t5rf3S3Ur1s_rA637CbFjJX0fUbsR2F2mrsEWNwaDP85v3nR6isA Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:54:58.728182 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6fdc472916934fac985e88fb6a61290b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 84a5fb262284400591cf29dd13771ee7 Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 5dc6a308-2725-417e-8596-d39f57306af5 could not be found. Jun 23 22:54:58.729971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '5dc6a308-2725-417e-8596-d39f57306af5'} Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dc6a308-2725-417e-8596-d39f57306af5 could not be found. Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:54:58.731029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dc6a308-2725-417e-8596-d39f57306af5 could not be found. Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dc6a308-2725-417e-8596-d39f57306af5 could not be found. Jun 23 22:54:58.732558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:58.733798 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Returning 404 to user: Instance 5dc6a308-2725-417e-8596-d39f57306af5 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:54:58.733798 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d856e6dd-b054-4296-9546-20beb69a87cc tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5" status: 404 len: 111 microversion: 2.1 time: 0.035046 Jun 23 22:54:58.736384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 574/1122] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:58 2022] GET /compute/v2.1/servers/5dc6a308-2725-417e-8596-d39f57306af5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 22:54:58.788631 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1deb5d91-fe16-4feb-8e75-0b9dc4ae3ce6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:58.801649 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1deb5d91-fe16-4feb-8e75-0b9dc4ae3ce6 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1362 microversion: 2.1 time: 0.275959 Jun 23 22:54:58.803540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 549/1123] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:58 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:54:59.246873 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:59.247376 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:59.254014 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:59.254440 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:59.255208 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:59.255676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:59.272999 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] HTTP exception thrown: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Request method failure captured: Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: DELETE /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 HTTP/1.1 Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO1Ifp4oILoHmPJSineDOmAtLsgWRSOxMJ8-GnSpfMX2-mQ9jiEAHf4gkqYsvbpjrcgsSfkV7OirX1iDTOIjn-1DNEZDVbqq-5DKX-vZejyeOSyP7BeMynoGED9t5rf3S3Ur1s_rA637CbFjJX0fUbsR2F2mrsEWNwaDP85v3nR6isA Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:54:59.274571 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6fdc472916934fac985e88fb6a61290b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 84a5fb262284400591cf29dd13771ee7 Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.276231 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '888abca9-182a-4b16-bca8-0d861635e4a8'} Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:54:59.277191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.278692 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.280196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Returning 404 to user: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:54:59.280196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7f0bc54c-ef9a-4c2c-836c-53e9730efa84 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 404 len: 111 microversion: 2.1 time: 0.033017 Jun 23 22:54:59.280196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 575/1124] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:54:59 2022] DELETE /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:54:59.284665 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:59.285283 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] [instance: 888abca9-182a-4b16-bca8-0d861635e4a8] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:59.291612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:59.292060 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:59.292841 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:59.293276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:59.307081 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] HTTP exception thrown: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Request method failure captured: Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 HTTP/1.1 Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO1Ifp4oILoHmPJSineDOmAtLsgWRSOxMJ8-GnSpfMX2-mQ9jiEAHf4gkqYsvbpjrcgsSfkV7OirX1iDTOIjn-1DNEZDVbqq-5DKX-vZejyeOSyP7BeMynoGED9t5rf3S3Ur1s_rA637CbFjJX0fUbsR2F2mrsEWNwaDP85v3nR6isA Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:54:59.308899 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6fdc472916934fac985e88fb6a61290b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6fdc472916934fac985e88fb6a61290b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 6fdc472916934fac985e88fb6a61290b Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-TestVolumeBootPattern-155797815 Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 84a5fb262284400591cf29dd13771ee7 Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-TestVolumeBootPattern-155797815-project Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.310607 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '888abca9-182a-4b16-bca8-0d861635e4a8'} Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:54:59.311686 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. Jun 23 22:54:59.313263 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:54:59.314713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Returning 404 to user: Instance 888abca9-182a-4b16-bca8-0d861635e4a8 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:54:59.314713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4b035392-c25d-43c5-be63-6e72244a3422 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8" status: 404 len: 111 microversion: 2.1 time: 0.029524 Jun 23 22:54:59.314713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 550/1125] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:59 2022] GET /compute/v2.1/servers/888abca9-182a-4b16-bca8-0d861635e4a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:54:59.819583 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6476a21f-5a7f-4f66-959a-b843cf4d2e86 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:54:59.821609 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6476a21f-5a7f-4f66-959a-b843cf4d2e86 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:54:59.826527 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6476a21f-5a7f-4f66-959a-b843cf4d2e86 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:59.827012 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6476a21f-5a7f-4f66-959a-b843cf4d2e86 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:59.827801 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6476a21f-5a7f-4f66-959a-b843cf4d2e86 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:54:59.828245 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6476a21f-5a7f-4f66-959a-b843cf4d2e86 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:54:59.965254 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6476a21f-5a7f-4f66-959a-b843cf4d2e86 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:54:59.972976 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6476a21f-5a7f-4f66-959a-b843cf4d2e86 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1362 microversion: 2.1 time: 0.157696 Jun 23 22:54:59.973537 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 576/1126] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:54:59 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:55:00.852069 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-93d2900d-5afc-4e6f-82be-d2dfb86ac713 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] Calling method '.version_select at 0x7fbbcad97f70>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:00.950793 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-93d2900d-5afc-4e6f-82be-d2dfb86ac713 tempest-TestVolumeBootPattern-155797815 tempest-TestVolumeBootPattern-155797815-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-546473830" status: 202 len: 0 microversion: 2.1 time: 0.103440 Jun 23 22:55:00.951441 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 551/1127] 10.222.0.33 () {58 vars in 1259 bytes} [Thu Jun 23 22:55:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-546473830 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:55:00.990934 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-96252c4d-3afa-4f0e-a3ee-b1cef57ee82d tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:00.991746 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-96252c4d-3afa-4f0e-a3ee-b1cef57ee82d tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:00.998995 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-96252c4d-3afa-4f0e-a3ee-b1cef57ee82d tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:01.000176 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-96252c4d-3afa-4f0e-a3ee-b1cef57ee82d tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:01.001107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-96252c4d-3afa-4f0e-a3ee-b1cef57ee82d tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:01.001681 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-96252c4d-3afa-4f0e-a3ee-b1cef57ee82d tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:01.144981 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-96252c4d-3afa-4f0e-a3ee-b1cef57ee82d tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:55:01.153413 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-96252c4d-3afa-4f0e-a3ee-b1cef57ee82d tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1362 microversion: 2.1 time: 0.166913 Jun 23 22:55:01.153962 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 577/1128] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:55:00 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:55:02.171698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fb0eaad3-8e40-4d7e-9a14-155595e81e10 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:02.172928 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fb0eaad3-8e40-4d7e-9a14-155595e81e10 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:02.180485 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0eaad3-8e40-4d7e-9a14-155595e81e10 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:02.183303 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0eaad3-8e40-4d7e-9a14-155595e81e10 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:02.183303 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0eaad3-8e40-4d7e-9a14-155595e81e10 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:02.183303 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fb0eaad3-8e40-4d7e-9a14-155595e81e10 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:02.351176 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fb0eaad3-8e40-4d7e-9a14-155595e81e10 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:55:02.359989 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fb0eaad3-8e40-4d7e-9a14-155595e81e10 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1362 microversion: 2.1 time: 0.192819 Jun 23 22:55:02.366453 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 552/1129] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:55:02 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:55:03.381822 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-06226bd5-cf54-4f3d-bd67-d3d72ee22360 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:03.382447 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-06226bd5-cf54-4f3d-bd67-d3d72ee22360 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:03.388963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-06226bd5-cf54-4f3d-bd67-d3d72ee22360 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:03.389369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-06226bd5-cf54-4f3d-bd67-d3d72ee22360 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:03.390148 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-06226bd5-cf54-4f3d-bd67-d3d72ee22360 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:03.390589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-06226bd5-cf54-4f3d-bd67-d3d72ee22360 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:03.823957 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-06226bd5-cf54-4f3d-bd67-d3d72ee22360 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:55:03.831627 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-06226bd5-cf54-4f3d-bd67-d3d72ee22360 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1362 microversion: 2.1 time: 0.454595 Jun 23 22:55:03.832290 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 578/1130] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:55:03 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:55:04.101217 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-c1e0172b-3787-4c0c-b071-1559f9f7c6a9 req-2329d673-6864-4c70-a6b9-c6c066beebd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d96a6eb-9a16-45e0-9398-11b2c47e05f2", "name": "network-vif-plugged", "status": "completed", "tag": "14d6421d-98b1-41b1-9d9c-46ba8373264e"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:55:04.107208 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:04.108179 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=6 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:04.115645 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c1e0172b-3787-4c0c-b071-1559f9f7c6a9 req-2329d673-6864-4c70-a6b9-c6c066beebd0 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:04.117425 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-c1e0172b-3787-4c0c-b071-1559f9f7c6a9 req-2329d673-6864-4c70-a6b9-c6c066beebd0 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:04.130022 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-c1e0172b-3787-4c0c-b071-1559f9f7c6a9 req-2329d673-6864-4c70-a6b9-c6c066beebd0 service nova] Creating event network-vif-plugged:14d6421d-98b1-41b1-9d9c-46ba8373264e for instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 on hv-cinder-81322 Jun 23 22:55:04.137102 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-c1e0172b-3787-4c0c-b071-1559f9f7c6a9 req-2329d673-6864-4c70-a6b9-c6c066beebd0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057318 Jun 23 22:55:04.137950 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 553/1131] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:55:04.851923 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d8b42d01-faa8-4781-9148-c3d796e7777c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:04.852463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d8b42d01-faa8-4781-9148-c3d796e7777c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:04.864125 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:04.867986 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d8b42d01-faa8-4781-9148-c3d796e7777c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:04.869284 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d8b42d01-faa8-4781-9148-c3d796e7777c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:04.872757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d8b42d01-faa8-4781-9148-c3d796e7777c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:04.872757 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d8b42d01-faa8-4781-9148-c3d796e7777c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:05.034606 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d8b42d01-faa8-4781-9148-c3d796e7777c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:55:05.042438 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d8b42d01-faa8-4781-9148-c3d796e7777c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1362 microversion: 2.1 time: 0.197604 Jun 23 22:55:05.043004 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 579/1132] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:55:04 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:55:06.060988 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-57f4affd-5db6-4d3b-b6d0-9b2451314f9f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:06.061713 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-57f4affd-5db6-4d3b-b6d0-9b2451314f9f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:06.068162 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:06.072987 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-57f4affd-5db6-4d3b-b6d0-9b2451314f9f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:06.073440 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-57f4affd-5db6-4d3b-b6d0-9b2451314f9f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:06.074226 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-57f4affd-5db6-4d3b-b6d0-9b2451314f9f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:06.074671 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-57f4affd-5db6-4d3b-b6d0-9b2451314f9f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:06.281940 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-57f4affd-5db6-4d3b-b6d0-9b2451314f9f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:55:06.302560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-57f4affd-5db6-4d3b-b6d0-9b2451314f9f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1362 microversion: 2.1 time: 0.246845 Jun 23 22:55:06.303152 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 554/1133] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:55:06 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:55:07.319211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1a6853ea-7d46-446e-bd7d-7dc52389cd60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:07.319928 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1a6853ea-7d46-446e-bd7d-7dc52389cd60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:07.322999 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:07.327750 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1a6853ea-7d46-446e-bd7d-7dc52389cd60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:07.328322 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1a6853ea-7d46-446e-bd7d-7dc52389cd60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:07.335589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1a6853ea-7d46-446e-bd7d-7dc52389cd60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:07.335589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1a6853ea-7d46-446e-bd7d-7dc52389cd60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:07.463669 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1a6853ea-7d46-446e-bd7d-7dc52389cd60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:55:07.473196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1a6853ea-7d46-446e-bd7d-7dc52389cd60 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1549 microversion: 2.1 time: 0.157539 Jun 23 22:55:07.485363 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 580/1134] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:55:07 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:55:07.496495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-87b7ff7d-fa6e-460c-9e88-0937f557e066 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:07.496495 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-87b7ff7d-fa6e-460c-9e88-0937f557e066 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:07.502093 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b7ff7d-fa6e-460c-9e88-0937f557e066 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:07.502553 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b7ff7d-fa6e-460c-9e88-0937f557e066 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:07.503329 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b7ff7d-fa6e-460c-9e88-0937f557e066 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:07.504349 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-87b7ff7d-fa6e-460c-9e88-0937f557e066 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:07.809035 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-87b7ff7d-fa6e-460c-9e88-0937f557e066 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.317865 Jun 23 22:55:07.809930 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 555/1135] 10.222.0.33 () {58 vars in 1274 bytes} [Thu Jun 23 22:55:07 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-interface => generated 285 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:55:08.950617 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-a1950c06-f521-48b3-97a8-f2a819aa0ad2 req-25281e1a-ecae-4cf2-820a-ee88d8e2057a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d96a6eb-9a16-45e0-9398-11b2c47e05f2", "tag": "14d6421d-98b1-41b1-9d9c-46ba8373264e"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:55:08.960922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-a1950c06-f521-48b3-97a8-f2a819aa0ad2 req-25281e1a-ecae-4cf2-820a-ee88d8e2057a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:08.961450 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-a1950c06-f521-48b3-97a8-f2a819aa0ad2 req-25281e1a-ecae-4cf2-820a-ee88d8e2057a service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:08.973597 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-a1950c06-f521-48b3-97a8-f2a819aa0ad2 req-25281e1a-ecae-4cf2-820a-ee88d8e2057a service nova] Creating event network-changed:14d6421d-98b1-41b1-9d9c-46ba8373264e for instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 on hv-cinder-81322 Jun 23 22:55:08.979154 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-a1950c06-f521-48b3-97a8-f2a819aa0ad2 req-25281e1a-ecae-4cf2-820a-ee88d8e2057a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032678 Jun 23 22:55:08.979917 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 581/1136] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 22:55:45.244981 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=3 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:45.245731 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=44 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:45.249658 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-15994b20-1d3c-4116-b2d8-c9fc6703873f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:45.250166 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-15994b20-1d3c-4116-b2d8-c9fc6703873f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:45.256194 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15994b20-1d3c-4116-b2d8-c9fc6703873f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:45.259531 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15994b20-1d3c-4116-b2d8-c9fc6703873f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:45.259531 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15994b20-1d3c-4116-b2d8-c9fc6703873f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:45.259531 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-15994b20-1d3c-4116-b2d8-c9fc6703873f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:45.281852 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-15994b20-1d3c-4116-b2d8-c9fc6703873f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/ips" status: 200 len: 146 microversion: 2.1 time: 0.038533 Jun 23 22:55:45.282418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 556/1137] 10.222.0.33 () {58 vars in 1247 bytes} [Thu Jun 23 22:55:45 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:55:46.906178 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0391190b-1e48-437a-a609-2b7b96393852 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d4fc5c2-6e0c-4db2-8e3e-289eb631dcbf"}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:55:46.907367 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0391190b-1e48-437a-a609-2b7b96393852 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:46.909702 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:46.910476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:55:46.916288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0391190b-1e48-437a-a609-2b7b96393852 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:46.921625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0391190b-1e48-437a-a609-2b7b96393852 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:46.921625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0391190b-1e48-437a-a609-2b7b96393852 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:46.921625 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0391190b-1e48-437a-a609-2b7b96393852 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:47.883860 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0391190b-1e48-437a-a609-2b7b96393852 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.981729 Jun 23 22:55:47.884678 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 582/1138] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:55:46 2022] POST /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments => generated 194 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:55:55.369030 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6e7a4111-b4f9-4ea3-85f2-550ba4c9f93f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:55.369948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6e7a4111-b4f9-4ea3-85f2-550ba4c9f93f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:55.377197 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e7a4111-b4f9-4ea3-85f2-550ba4c9f93f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:55.377653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e7a4111-b4f9-4ea3-85f2-550ba4c9f93f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:55.378409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e7a4111-b4f9-4ea3-85f2-550ba4c9f93f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:55.378847 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6e7a4111-b4f9-4ea3-85f2-550ba4c9f93f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:55.409188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6e7a4111-b4f9-4ea3-85f2-550ba4c9f93f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Jun 23 22:55:55.409723 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 557/1139] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:55:55 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:55:55.420723 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7dc9f687-1626-4d87-974e-1ddd7d636be3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:55:55.421304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7dc9f687-1626-4d87-974e-1ddd7d636be3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:55.427857 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7dc9f687-1626-4d87-974e-1ddd7d636be3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:55.428299 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7dc9f687-1626-4d87-974e-1ddd7d636be3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:55.429665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7dc9f687-1626-4d87-974e-1ddd7d636be3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:55.430099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7dc9f687-1626-4d87-974e-1ddd7d636be3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:55.457214 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7dc9f687-1626-4d87-974e-1ddd7d636be3 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/4d4fc5c2-6e0c-4db2-8e3e-289eb631dcbf" status: 200 len: 194 microversion: 2.1 time: 0.040856 Jun 23 22:55:55.457781 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 583/1140] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 23 22:55:55 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/4d4fc5c2-6e0c-4db2-8e3e-289eb631dcbf => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:55:57.091794 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d05399ce-db12-4fa8-9ac5-4662f5bb8f01 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31b698a6-fdff-49d4-8a56-d06e6f0323f4"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:55:57.092889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d05399ce-db12-4fa8-9ac5-4662f5bb8f01 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:55:57.099511 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d05399ce-db12-4fa8-9ac5-4662f5bb8f01 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:57.099962 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d05399ce-db12-4fa8-9ac5-4662f5bb8f01 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:57.101321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d05399ce-db12-4fa8-9ac5-4662f5bb8f01 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:55:57.101765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d05399ce-db12-4fa8-9ac5-4662f5bb8f01 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:55:57.922582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d05399ce-db12-4fa8-9ac5-4662f5bb8f01 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "POST /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834480 Jun 23 22:55:57.923245 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 558/1141] 10.222.0.33 () {60 vars in 1322 bytes} [Thu Jun 23 22:55:57 2022] POST /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:56:05.397567 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-7ddb12bf-e096-4565-94d1-bfa31084755c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:05.398517 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-7ddb12bf-e096-4565-94d1-bfa31084755c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:05.405114 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ddb12bf-e096-4565-94d1-bfa31084755c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:05.405562 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ddb12bf-e096-4565-94d1-bfa31084755c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:05.406304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ddb12bf-e096-4565-94d1-bfa31084755c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:05.406736 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-7ddb12bf-e096-4565-94d1-bfa31084755c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:05.435862 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-7ddb12bf-e096-4565-94d1-bfa31084755c tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042846 Jun 23 22:56:05.436394 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 584/1142] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:56:05 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:56:05.578996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ecac34ce-065e-4730-8089-1cee0a7a23ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:05.579560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ecac34ce-065e-4730-8089-1cee0a7a23ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:05.585858 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ecac34ce-065e-4730-8089-1cee0a7a23ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:05.586304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ecac34ce-065e-4730-8089-1cee0a7a23ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:05.587062 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ecac34ce-065e-4730-8089-1cee0a7a23ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:05.587500 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ecac34ce-065e-4730-8089-1cee0a7a23ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:05.615242 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ecac34ce-065e-4730-8089-1cee0a7a23ab tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/4d4fc5c2-6e0c-4db2-8e3e-289eb631dcbf" status: 200 len: 194 microversion: 2.1 time: 0.041250 Jun 23 22:56:05.616400 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 559/1143] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 23 22:56:05 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/4d4fc5c2-6e0c-4db2-8e3e-289eb631dcbf => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:56:05.626008 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-ed9d8498-a822-4b64-bc13-afe07e8adb1a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:05.626524 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-ed9d8498-a822-4b64-bc13-afe07e8adb1a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:05.633193 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed9d8498-a822-4b64-bc13-afe07e8adb1a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:05.633635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed9d8498-a822-4b64-bc13-afe07e8adb1a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:05.634383 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed9d8498-a822-4b64-bc13-afe07e8adb1a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:05.634811 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-ed9d8498-a822-4b64-bc13-afe07e8adb1a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:05.712385 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-ed9d8498-a822-4b64-bc13-afe07e8adb1a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lazy-loading 'services' on Instance uuid 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:56:05.934948 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-ed9d8498-a822-4b64-bc13-afe07e8adb1a tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/4d4fc5c2-6e0c-4db2-8e3e-289eb631dcbf" status: 202 len: 0 microversion: 2.1 time: 0.312629 Jun 23 22:56:05.935521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 585/1144] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:56:05 2022] DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/4d4fc5c2-6e0c-4db2-8e3e-289eb631dcbf => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:56:07.046008 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-21139219-2fa4-4510-a569-3637683e0a20 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:07.046611 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-21139219-2fa4-4510-a569-3637683e0a20 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:07.053109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21139219-2fa4-4510-a569-3637683e0a20 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:07.057536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21139219-2fa4-4510-a569-3637683e0a20 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:07.057536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21139219-2fa4-4510-a569-3637683e0a20 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:07.057536 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-21139219-2fa4-4510-a569-3637683e0a20 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:07.083490 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-21139219-2fa4-4510-a569-3637683e0a20 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/31b698a6-fdff-49d4-8a56-d06e6f0323f4" status: 200 len: 194 microversion: 2.1 time: 0.041368 Jun 23 22:56:07.087492 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 560/1145] 10.222.0.33 () {58 vars in 1412 bytes} [Thu Jun 23 22:56:07 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/31b698a6-fdff-49d4-8a56-d06e6f0323f4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:56:07.095311 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c798820c-d145-40d8-b916-7e10aa335131 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:07.100835 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c798820c-d145-40d8-b916-7e10aa335131 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:07.103915 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c798820c-d145-40d8-b916-7e10aa335131 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:07.104355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c798820c-d145-40d8-b916-7e10aa335131 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:07.105138 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c798820c-d145-40d8-b916-7e10aa335131 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:07.105574 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c798820c-d145-40d8-b916-7e10aa335131 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:07.186324 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-c798820c-d145-40d8-b916-7e10aa335131 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lazy-loading 'services' on Instance uuid 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:56:07.414684 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c798820c-d145-40d8-b916-7e10aa335131 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/31b698a6-fdff-49d4-8a56-d06e6f0323f4" status: 202 len: 0 microversion: 2.1 time: 0.323848 Jun 23 22:56:07.415274 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 586/1146] 10.222.0.33 () {58 vars in 1415 bytes} [Thu Jun 23 22:56:07 2022] DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments/31b698a6-fdff-49d4-8a56-d06e6f0323f4 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:56:08.569551 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-047dc6b8-0726-4a9d-bfc8-319b0656050f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:08.570538 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-047dc6b8-0726-4a9d-bfc8-319b0656050f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:08.577098 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-047dc6b8-0726-4a9d-bfc8-319b0656050f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:08.577549 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-047dc6b8-0726-4a9d-bfc8-319b0656050f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:08.578308 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-047dc6b8-0726-4a9d-bfc8-319b0656050f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:08.578745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-047dc6b8-0726-4a9d-bfc8-319b0656050f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:08.608230 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-047dc6b8-0726-4a9d-bfc8-319b0656050f tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042543 Jun 23 22:56:08.608806 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 561/1147] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:56:08 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:56:08.711506 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9505fe57-f2fa-473b-b4ad-d18de8acab71 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:08.712589 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9505fe57-f2fa-473b-b4ad-d18de8acab71 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:08.718748 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9505fe57-f2fa-473b-b4ad-d18de8acab71 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:08.719198 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9505fe57-f2fa-473b-b4ad-d18de8acab71 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:08.719959 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9505fe57-f2fa-473b-b4ad-d18de8acab71 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:08.720399 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9505fe57-f2fa-473b-b4ad-d18de8acab71 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:08.748840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9505fe57-f2fa-473b-b4ad-d18de8acab71 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042430 Jun 23 22:56:08.749328 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 587/1148] 10.222.0.33 () {58 vars in 1301 bytes} [Thu Jun 23 22:56:08 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 22:56:08.805218 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8981f3a7-5c9b-418c-b94c-1dd7b7f38f1e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:08.805717 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8981f3a7-5c9b-418c-b94c-1dd7b7f38f1e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:08.811654 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8981f3a7-5c9b-418c-b94c-1dd7b7f38f1e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:08.812109 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8981f3a7-5c9b-418c-b94c-1dd7b7f38f1e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:08.812906 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8981f3a7-5c9b-418c-b94c-1dd7b7f38f1e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:08.813347 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-8981f3a7-5c9b-418c-b94c-1dd7b7f38f1e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:08.838970 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8981f3a7-5c9b-418c-b94c-1dd7b7f38f1e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:56:09.097829 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8981f3a7-5c9b-418c-b94c-1dd7b7f38f1e tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 204 len: 0 microversion: 2.1 time: 0.295894 Jun 23 22:56:09.098387 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 562/1149] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:56:08 2022] DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 22:56:09.109381 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8f2e76d8-4fa3-485b-ba23-1aaeebd4d057 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:09.110000 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8f2e76d8-4fa3-485b-ba23-1aaeebd4d057 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:09.116866 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8f2e76d8-4fa3-485b-ba23-1aaeebd4d057 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:09.117329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8f2e76d8-4fa3-485b-ba23-1aaeebd4d057 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:09.118206 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8f2e76d8-4fa3-485b-ba23-1aaeebd4d057 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:09.118649 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8f2e76d8-4fa3-485b-ba23-1aaeebd4d057 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:09.248795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-8f2e76d8-4fa3-485b-ba23-1aaeebd4d057 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:09.257275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8f2e76d8-4fa3-485b-ba23-1aaeebd4d057 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1673 microversion: 2.1 time: 0.151738 Jun 23 22:56:09.257834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 588/1150] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:09 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:10.275031 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d150fc17-ff37-44db-b72b-aa8da6cbe5fa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:10.275757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d150fc17-ff37-44db-b72b-aa8da6cbe5fa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:10.282207 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d150fc17-ff37-44db-b72b-aa8da6cbe5fa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:10.285106 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d150fc17-ff37-44db-b72b-aa8da6cbe5fa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:10.285106 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d150fc17-ff37-44db-b72b-aa8da6cbe5fa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:10.285106 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d150fc17-ff37-44db-b72b-aa8da6cbe5fa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:10.417868 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d150fc17-ff37-44db-b72b-aa8da6cbe5fa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:10.425398 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d150fc17-ff37-44db-b72b-aa8da6cbe5fa tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1673 microversion: 2.1 time: 0.154680 Jun 23 22:56:10.425957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 563/1151] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:10 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:11.442810 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5e31f85d-df2c-4594-b2bd-2bdaba80eca9 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:11.443509 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5e31f85d-df2c-4594-b2bd-2bdaba80eca9 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:11.450198 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5e31f85d-df2c-4594-b2bd-2bdaba80eca9 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:11.450642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5e31f85d-df2c-4594-b2bd-2bdaba80eca9 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:11.451439 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5e31f85d-df2c-4594-b2bd-2bdaba80eca9 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:11.451870 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5e31f85d-df2c-4594-b2bd-2bdaba80eca9 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:11.589191 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5e31f85d-df2c-4594-b2bd-2bdaba80eca9 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:11.596963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5e31f85d-df2c-4594-b2bd-2bdaba80eca9 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1673 microversion: 2.1 time: 0.157930 Jun 23 22:56:11.607548 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 589/1152] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:11 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:11.957351 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-e14e2463-48f3-4483-8d71-eb8cb03902ef req-54e1e86a-d35c-4a37-b235-8c47999b96ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d96a6eb-9a16-45e0-9398-11b2c47e05f2", "name": "network-vif-deleted", "tag": "14d6421d-98b1-41b1-9d9c-46ba8373264e"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:56:11.969576 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-e14e2463-48f3-4483-8d71-eb8cb03902ef req-54e1e86a-d35c-4a37-b235-8c47999b96ba service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:11.970582 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-e14e2463-48f3-4483-8d71-eb8cb03902ef req-54e1e86a-d35c-4a37-b235-8c47999b96ba service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:11.987489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-e14e2463-48f3-4483-8d71-eb8cb03902ef req-54e1e86a-d35c-4a37-b235-8c47999b96ba service nova] Creating event network-vif-deleted:14d6421d-98b1-41b1-9d9c-46ba8373264e for instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 on hv-cinder-81322 Jun 23 22:56:11.993465 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-e14e2463-48f3-4483-8d71-eb8cb03902ef req-54e1e86a-d35c-4a37-b235-8c47999b96ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107408 Jun 23 22:56:11.994331 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 564/1153] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:56:12.615777 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:12.617023 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:12.623797 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:12.624250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:12.625383 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:12.625821 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:12.660603 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:12.661073 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:12.661516 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lazy-loading 'fault' on Instance uuid 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:56:12.714429 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ce6158277146228cb13194e9d7b04b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73d61a582ec24f99aaf018e55f1f049b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:12.722170 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-5ec4c6fc-ce87-4616-991a-22720b3c0af0 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 200 len: 1326 microversion: 2.1 time: 0.110865 Jun 23 22:56:12.722996 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 590/1154] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:12 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 1326 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:13.740457 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:13.741392 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:13.748154 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:13.748627 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:13.749381 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:13.749814 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:13.763346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] HTTP exception thrown: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Request method failure captured: Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 HTTP/1.1 Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO5kSAC1p1AsJQTpi-EXqQnUj5baXouRWfVr43sjMqIJi0rMvS7iAeGdd2Xqm_vS2KpIbYOnoHbttNEwnxphbWhRKwqNnjOsKConqQhqQd9RD-35XZu1Rz_Hm0BhkJma6aoTwXLBnVfC3hFHo3ZiCaCJZZ7f0jouvuDWuqoTwexCG5o Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:56:13.765047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73d61a582ec24f99aaf018e55f1f049b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 92ce6158277146228cb13194e9d7b04b Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:13.766781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '9d96a6eb-9a16-45e0-9398-11b2c47e05f2'} Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:56:13.767789 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:13.770974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:13.773053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Returning 404 to user: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:56:13.773053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a827a53b-492d-4d05-8af3-5b253909ae7b tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 404 len: 111 microversion: 2.1 time: 0.030255 Jun 23 22:56:13.773053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 565/1155] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:13 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:56:13.775734 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-02aba294-681c-43be-83bb-e32c39cd8e79 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '.version_select at 0x7fbbca3fcee0>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:13.890910 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-02aba294-681c-43be-83bb-e32c39cd8e79 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424624625" status: 202 len: 0 microversion: 2.1 time: 0.119429 Jun 23 22:56:13.891483 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 591/1156] 10.222.0.33 () {58 vars in 1217 bytes} [Thu Jun 23 22:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424624625 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 22:56:17.352427 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:17.352941 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:17.359452 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:17.359893 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:17.360669 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:17.361102 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:17.376141 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] HTTP exception thrown: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Request method failure captured: Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 HTTP/1.1 Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO5kSAC1p1AsJQTpi-EXqQnUj5baXouRWfVr43sjMqIJi0rMvS7iAeGdd2Xqm_vS2KpIbYOnoHbttNEwnxphbWhRKwqNnjOsKConqQhqQd9RD-35XZu1Rz_Hm0BhkJma6aoTwXLBnVfC3hFHo3ZiCaCJZZ7f0jouvuDWuqoTwexCG5o Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:56:17.377685 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73d61a582ec24f99aaf018e55f1f049b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 92ce6158277146228cb13194e9d7b04b Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.379322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '9d96a6eb-9a16-45e0-9398-11b2c47e05f2'} Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:56:17.380344 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.382521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.384309 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Returning 404 to user: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:56:17.384309 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-02931b54-d69c-4281-93f9-d2c493d8c189 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 404 len: 111 microversion: 2.1 time: 0.030551 Jun 23 22:56:17.384309 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 566/1157] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:56:17 2022] DELETE /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:56:17.387633 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:17.388243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 9d96a6eb-9a16-45e0-9398-11b2c47e05f2] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:17.390786 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:56:17.396067 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:17.397112 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:17.397850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:17.398281 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:17.400849 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:56:17.411816 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] HTTP exception thrown: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Request method failure captured: Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 HTTP/1.1 Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO5kSAC1p1AsJQTpi-EXqQnUj5baXouRWfVr43sjMqIJi0rMvS7iAeGdd2Xqm_vS2KpIbYOnoHbttNEwnxphbWhRKwqNnjOsKConqQhqQd9RD-35XZu1Rz_Hm0BhkJma6aoTwXLBnVfC3hFHo3ZiCaCJZZ7f0jouvuDWuqoTwexCG5o Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:56:17.413443 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73d61a582ec24f99aaf018e55f1f049b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 92ce6158277146228cb13194e9d7b04b Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.415084 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '9d96a6eb-9a16-45e0-9398-11b2c47e05f2'} Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:56:17.416108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. Jun 23 22:56:17.417727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:17.419212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Returning 404 to user: Instance 9d96a6eb-9a16-45e0-9398-11b2c47e05f2 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:56:17.419212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-010abca3-f189-4700-86e3-ef901554cc87 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2" status: 404 len: 111 microversion: 2.1 time: 0.030987 Jun 23 22:56:17.419212 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 592/1158] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:17 2022] GET /compute/v2.1/servers/9d96a6eb-9a16-45e0-9398-11b2c47e05f2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:56:18.669339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:18.669861 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:18.676199 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:18.676679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:18.677521 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:18.678119 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:18.691370 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.wsgi [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] HTTP exception thrown: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Request method failure captured: Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: request: DELETE /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f HTTP/1.1 Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept: application/json Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Accept-Encoding: identity Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Connection: close Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Length: 0 Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Content-Type: application/json Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Host: 10.222.0.33 Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Openstack-System-Scope: None Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: User-Agent: python-urllib3/1.26.9 Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Auth-Token: gAAAAABitO5kSAC1p1AsJQTpi-EXqQnUj5baXouRWfVr43sjMqIJi0rMvS7iAeGdd2Xqm_vS2KpIbYOnoHbttNEwnxphbWhRKwqNnjOsKConqQhqQd9RD-35XZu1Rz_Hm0BhkJma6aoTwXLBnVfC3hFHo3ZiCaCJZZ7f0jouvuDWuqoTwexCG5o Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Id: None Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Domain-Name: None Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Identity-Status: Confirmed Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Is-Admin-Project: True Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Id: default Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Domain-Name: Default Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Project-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Role: member,reader Jun 23 22:56:18.693430 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Roles: member,reader Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73d61a582ec24f99aaf018e55f1f049b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Id: default Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Domain-Name: Default Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Id: 92ce6158277146228cb13194e9d7b04b Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: X-User-Name: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: method: > Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: exception: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.694971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: action_args: {'id': '60601697-91f9-4db0-9d49-5fdd0ff5387f'} Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:56:18.695751 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.697123 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.698383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Returning 404 to user: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. {{(pid=124725) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:56:18.698383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-083dda71-22c8-4eb2-95df-6148de09f5f8 tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 404 len: 111 microversion: 2.1 time: 0.029671 Jun 23 22:56:18.698383 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 567/1159] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:56:18 2022] DELETE /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:56:18.703660 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:18.704277 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] [instance: 60601697-91f9-4db0-9d49-5fdd0ff5387f] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:18.712727 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:18.713174 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:18.713928 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:18.714359 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:18.727632 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] HTTP exception thrown: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Request method failure captured: Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f HTTP/1.1 Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO5kSAC1p1AsJQTpi-EXqQnUj5baXouRWfVr43sjMqIJi0rMvS7iAeGdd2Xqm_vS2KpIbYOnoHbttNEwnxphbWhRKwqNnjOsKConqQhqQd9RD-35XZu1Rz_Hm0BhkJma6aoTwXLBnVfC3hFHo3ZiCaCJZZ7f0jouvuDWuqoTwexCG5o Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:56:18.729165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_73d61a582ec24f99aaf018e55f1f049b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/73d61a582ec24f99aaf018e55f1f049b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 73d61a582ec24f99aaf018e55f1f049b Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1473601525 Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 92ce6158277146228cb13194e9d7b04b Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-AttachVolumeTestJSON-1473601525-project Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.730809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '60601697-91f9-4db0-9d49-5fdd0ff5387f'} Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:56:18.731718 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. Jun 23 22:56:18.733364 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:56:18.734723 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] Returning 404 to user: Instance 60601697-91f9-4db0-9d49-5fdd0ff5387f could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:56:18.734723 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-426a4210-1638-414e-8ffa-17da2f79c8ff tempest-AttachVolumeTestJSON-1473601525 tempest-AttachVolumeTestJSON-1473601525-project] 10.222.0.33 "GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f" status: 404 len: 111 microversion: 2.1 time: 0.030645 Jun 23 22:56:18.734723 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 593/1160] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:18 2022] GET /compute/v2.1/servers/60601697-91f9-4db0-9d49-5fdd0ff5387f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:56:50.257974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1515622904", "imageRef": "bb9fe5e8-425f-421f-9204-8a82b82e7143", "flavorRef": "452"}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:56:50.263996 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:56:50.264676 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:56:50.311539 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.network.neutron [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] validate_networks() for None {{(pid=124725) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:56:50.575957 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Flavor limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:56:50.576381 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Image limits 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:56:50.576895 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Flavor pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:56:50.577310 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Image pref 0:0:0 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:56:50.577720 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.virt.hardware [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124725) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:56:50.586744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:50.587198 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:50.587994 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:50.588429 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:50.604933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Getting quotas for project 9e9c5c553b604f5a8f5a287782c998c7. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:56:50.608840 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Getting quotas for user 4d0c9e94f3854a37948f247ca8e09c2a and project 9e9c5c553b604f5a8f5a287782c998c7. Resources: {'cores', 'instances', 'ram'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:56:50.620025 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Going to run 1 instances... {{(pid=124725) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:56:50.622355 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bb9fe5e8-425f-421f-9204-8a82b82e7143',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124725) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:56:50.782956 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-9b6d44af-421e-4f5f-a0e3-3e13cd50cd4b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529240 Jun 23 22:56:50.783504 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 568/1161] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:56:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:56:50.793964 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c148f86d-8f6a-4577-94b7-27f691b51d08 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:50.794570 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c148f86d-8f6a-4577-94b7-27f691b51d08 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:50.852292 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c148f86d-8f6a-4577-94b7-27f691b51d08 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:50.859087 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c148f86d-8f6a-4577-94b7-27f691b51d08 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1215 microversion: 2.1 time: 0.069554 Jun 23 22:56:50.859642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 594/1162] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:50 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:51.875698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-8f11e4d8-84ec-4eb5-8776-22ad48a69596 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:51.876289 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-8f11e4d8-84ec-4eb5-8776-22ad48a69596 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:51.928409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-8f11e4d8-84ec-4eb5-8776-22ad48a69596 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:51.936846 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-8f11e4d8-84ec-4eb5-8776-22ad48a69596 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1215 microversion: 2.1 time: 0.065419 Jun 23 22:56:51.937484 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 569/1163] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:51 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:52.953610 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-255469bd-396e-4333-bf45-87e3ea575c67 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:52.954225 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-255469bd-396e-4333-bf45-87e3ea575c67 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:53.006135 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-255469bd-396e-4333-bf45-87e3ea575c67 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:53.013788 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-255469bd-396e-4333-bf45-87e3ea575c67 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1215 microversion: 2.1 time: 0.064041 Jun 23 22:56:53.014344 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 595/1164] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:52 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:54.030960 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-f149b1c8-bb5c-46cc-a9d9-1179ead31782 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:54.031574 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-f149b1c8-bb5c-46cc-a9d9-1179ead31782 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:54.086168 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-f149b1c8-bb5c-46cc-a9d9-1179ead31782 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:54.092776 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-f149b1c8-bb5c-46cc-a9d9-1179ead31782 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1215 microversion: 2.1 time: 0.065674 Jun 23 22:56:54.093339 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 570/1165] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:54 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:55.109160 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c9a22881-1023-485d-919e-a0fef8364469 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:55.109805 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c9a22881-1023-485d-919e-a0fef8364469 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:55.116520 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c9a22881-1023-485d-919e-a0fef8364469 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:55.117001 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c9a22881-1023-485d-919e-a0fef8364469 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:55.117752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c9a22881-1023-485d-919e-a0fef8364469 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:55.118188 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c9a22881-1023-485d-919e-a0fef8364469 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:55.178091 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c9a22881-1023-485d-919e-a0fef8364469 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:55.185456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c9a22881-1023-485d-919e-a0fef8364469 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1219 microversion: 2.1 time: 0.080071 Jun 23 22:56:55.185956 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 596/1166] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:55 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:56.201709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-1aa7210a-93fa-4c3c-88da-75b95bf7865a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:56.202244 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-1aa7210a-93fa-4c3c-88da-75b95bf7865a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:56.208755 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aa7210a-93fa-4c3c-88da-75b95bf7865a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:56.209205 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aa7210a-93fa-4c3c-88da-75b95bf7865a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:56.209961 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aa7210a-93fa-4c3c-88da-75b95bf7865a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:56.210399 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-1aa7210a-93fa-4c3c-88da-75b95bf7865a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:56.271076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-1aa7210a-93fa-4c3c-88da-75b95bf7865a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:56.279010 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-1aa7210a-93fa-4c3c-88da-75b95bf7865a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1219 microversion: 2.1 time: 0.081372 Jun 23 22:56:56.279647 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 571/1167] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:56 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:57.296870 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4b73c62b-9eb0-4094-9f64-b7ca03ab324d tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:57.297485 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4b73c62b-9eb0-4094-9f64-b7ca03ab324d tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:57.304594 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4b73c62b-9eb0-4094-9f64-b7ca03ab324d tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:57.305053 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4b73c62b-9eb0-4094-9f64-b7ca03ab324d tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:57.305818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4b73c62b-9eb0-4094-9f64-b7ca03ab324d tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:57.306446 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4b73c62b-9eb0-4094-9f64-b7ca03ab324d tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:57.370659 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4b73c62b-9eb0-4094-9f64-b7ca03ab324d tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:57.378030 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4b73c62b-9eb0-4094-9f64-b7ca03ab324d tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1273 microversion: 2.1 time: 0.085102 Jun 23 22:56:57.379421 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 597/1168] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:57 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:58.395241 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-038491fa-8482-4599-ad78-65c6797a2746 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:58.395866 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-038491fa-8482-4599-ad78-65c6797a2746 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:58.402561 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-038491fa-8482-4599-ad78-65c6797a2746 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:58.403051 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-038491fa-8482-4599-ad78-65c6797a2746 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:58.404020 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-038491fa-8482-4599-ad78-65c6797a2746 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:58.404464 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-038491fa-8482-4599-ad78-65c6797a2746 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:58.570023 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-038491fa-8482-4599-ad78-65c6797a2746 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:58.577522 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-038491fa-8482-4599-ad78-65c6797a2746 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1315 microversion: 2.1 time: 0.186238 Jun 23 22:56:58.578087 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 572/1169] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:58 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:56:58.923948 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-b12caeed-35dc-4f2a-bb57-9acd4936c083 req-835d50ca-421a-4596-ae90-6f2e74afcbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c87770-17a1-424f-b010-21dd54ef5e11", "tag": "4242cf2c-7225-4374-b59e-afd9151baaa4"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:56:58.934040 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-b12caeed-35dc-4f2a-bb57-9acd4936c083 req-835d50ca-421a-4596-ae90-6f2e74afcbe0 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:58.934600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-b12caeed-35dc-4f2a-bb57-9acd4936c083 req-835d50ca-421a-4596-ae90-6f2e74afcbe0 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:58.953624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-b12caeed-35dc-4f2a-bb57-9acd4936c083 req-835d50ca-421a-4596-ae90-6f2e74afcbe0 service nova] Creating event network-changed:4242cf2c-7225-4374-b59e-afd9151baaa4 for instance f4c87770-17a1-424f-b010-21dd54ef5e11 on hv-cinder-81322 Jun 23 22:56:58.959479 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-b12caeed-35dc-4f2a-bb57-9acd4936c083 req-835d50ca-421a-4596-ae90-6f2e74afcbe0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040781 Jun 23 22:56:58.960275 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 598/1170] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:56:59.594385 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-28c864a8-9b46-43be-aa95-9e65410b73ce tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:56:59.594997 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-28c864a8-9b46-43be-aa95-9e65410b73ce tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:56:59.601944 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28c864a8-9b46-43be-aa95-9e65410b73ce tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:59.602390 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28c864a8-9b46-43be-aa95-9e65410b73ce tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:59.603157 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28c864a8-9b46-43be-aa95-9e65410b73ce tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:56:59.603594 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-28c864a8-9b46-43be-aa95-9e65410b73ce tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:56:59.735129 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-28c864a8-9b46-43be-aa95-9e65410b73ce tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:56:59.743395 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-28c864a8-9b46-43be-aa95-9e65410b73ce tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1315 microversion: 2.1 time: 0.152869 Jun 23 22:56:59.743965 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 573/1171] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:56:59 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:00.761281 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-d81e9ab4-78d7-404f-ada4-b4e28a49d0e0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:00.761980 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-d81e9ab4-78d7-404f-ada4-b4e28a49d0e0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:00.768427 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d81e9ab4-78d7-404f-ada4-b4e28a49d0e0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:00.769521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d81e9ab4-78d7-404f-ada4-b4e28a49d0e0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:00.770279 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d81e9ab4-78d7-404f-ada4-b4e28a49d0e0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:00.770716 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-d81e9ab4-78d7-404f-ada4-b4e28a49d0e0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:00.905151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-d81e9ab4-78d7-404f-ada4-b4e28a49d0e0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:00.912993 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-d81e9ab4-78d7-404f-ada4-b4e28a49d0e0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1315 microversion: 2.1 time: 0.156389 Jun 23 22:57:00.913543 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 599/1172] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:00 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:01.930217 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-c1da143b-f8cf-4e0a-a19c-9b2a45cf3a45 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:01.930856 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-c1da143b-f8cf-4e0a-a19c-9b2a45cf3a45 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:01.932818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:01.938132 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1da143b-f8cf-4e0a-a19c-9b2a45cf3a45 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:01.938577 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1da143b-f8cf-4e0a-a19c-9b2a45cf3a45 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:01.939321 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1da143b-f8cf-4e0a-a19c-9b2a45cf3a45 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:01.939783 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-c1da143b-f8cf-4e0a-a19c-9b2a45cf3a45 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:02.068765 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-c1da143b-f8cf-4e0a-a19c-9b2a45cf3a45 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:02.074667 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-c1da143b-f8cf-4e0a-a19c-9b2a45cf3a45 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1315 microversion: 2.1 time: 0.148338 Jun 23 22:57:02.075232 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 574/1173] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:01 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:03.091123 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e0be97ad-6aa3-45c6-bfcc-aff43323a64f tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:03.091738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e0be97ad-6aa3-45c6-bfcc-aff43323a64f tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:03.094137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=4 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:03.102738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e0be97ad-6aa3-45c6-bfcc-aff43323a64f tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:03.102738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e0be97ad-6aa3-45c6-bfcc-aff43323a64f tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:03.102738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e0be97ad-6aa3-45c6-bfcc-aff43323a64f tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:03.102738 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e0be97ad-6aa3-45c6-bfcc-aff43323a64f tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:03.226662 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e0be97ad-6aa3-45c6-bfcc-aff43323a64f tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:03.234087 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e0be97ad-6aa3-45c6-bfcc-aff43323a64f tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1315 microversion: 2.1 time: 0.146802 Jun 23 22:57:03.234673 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 600/1174] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:03 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:04.251269 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7867b151-3f20-43a5-a239-8b09cfcc6099 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:04.251877 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7867b151-3f20-43a5-a239-8b09cfcc6099 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:04.254745 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=10 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:04.259651 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7867b151-3f20-43a5-a239-8b09cfcc6099 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:04.260103 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7867b151-3f20-43a5-a239-8b09cfcc6099 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:04.260912 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7867b151-3f20-43a5-a239-8b09cfcc6099 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:04.261349 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7867b151-3f20-43a5-a239-8b09cfcc6099 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:04.395864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7867b151-3f20-43a5-a239-8b09cfcc6099 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:04.403268 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7867b151-3f20-43a5-a239-8b09cfcc6099 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1315 microversion: 2.1 time: 0.155921 Jun 23 22:57:04.403833 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 575/1175] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:04 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:04.703419 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-7ba40384-cfe8-4198-92a5-6c58d412b900 req-13e0aa4d-4268-4a18-9cbe-96a7c3657e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c87770-17a1-424f-b010-21dd54ef5e11", "name": "network-vif-plugged", "status": "completed", "tag": "4242cf2c-7225-4374-b59e-afd9151baaa4"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:57:04.712090 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7ba40384-cfe8-4198-92a5-6c58d412b900 req-13e0aa4d-4268-4a18-9cbe-96a7c3657e4d service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:04.712544 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7ba40384-cfe8-4198-92a5-6c58d412b900 req-13e0aa4d-4268-4a18-9cbe-96a7c3657e4d service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:04.724944 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-7ba40384-cfe8-4198-92a5-6c58d412b900 req-13e0aa4d-4268-4a18-9cbe-96a7c3657e4d service nova] Creating event network-vif-plugged:4242cf2c-7225-4374-b59e-afd9151baaa4 for instance f4c87770-17a1-424f-b010-21dd54ef5e11 on hv-cinder-81322 Jun 23 22:57:04.729892 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-7ba40384-cfe8-4198-92a5-6c58d412b900 req-13e0aa4d-4268-4a18-9cbe-96a7c3657e4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149130 Jun 23 22:57:04.730476 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 601/1176] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:57:05.420813 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-228855f5-de0f-46df-9712-dd643a659fa0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:05.421409 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-228855f5-de0f-46df-9712-dd643a659fa0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:05.428413 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-228855f5-de0f-46df-9712-dd643a659fa0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:05.428889 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-228855f5-de0f-46df-9712-dd643a659fa0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:05.429641 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-228855f5-de0f-46df-9712-dd643a659fa0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:05.430074 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-228855f5-de0f-46df-9712-dd643a659fa0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:05.556117 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-228855f5-de0f-46df-9712-dd643a659fa0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:05.563469 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-228855f5-de0f-46df-9712-dd643a659fa0 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1315 microversion: 2.1 time: 0.146572 Jun 23 22:57:05.564026 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 576/1177] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:05 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:06.582488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-fe29befa-4114-4b66-8b75-e7e2a14af65a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:06.583111 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-fe29befa-4114-4b66-8b75-e7e2a14af65a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:06.589289 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fe29befa-4114-4b66-8b75-e7e2a14af65a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:06.589732 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fe29befa-4114-4b66-8b75-e7e2a14af65a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:06.590823 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fe29befa-4114-4b66-8b75-e7e2a14af65a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:06.590927 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-fe29befa-4114-4b66-8b75-e7e2a14af65a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:06.725665 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-fe29befa-4114-4b66-8b75-e7e2a14af65a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:06.733242 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-fe29befa-4114-4b66-8b75-e7e2a14af65a tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1465 microversion: 2.1 time: 0.156110 Jun 23 22:57:06.733810 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 602/1178] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:06 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:06.774533 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-06bcaed1-1077-4940-b5c2-6ac1a8f35024 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:06.775045 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-06bcaed1-1077-4940-b5c2-6ac1a8f35024 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:06.781340 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-06bcaed1-1077-4940-b5c2-6ac1a8f35024 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:06.781781 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-06bcaed1-1077-4940-b5c2-6ac1a8f35024 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:06.782534 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-06bcaed1-1077-4940-b5c2-6ac1a8f35024 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:06.782967 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-06bcaed1-1077-4940-b5c2-6ac1a8f35024 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:06.808204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-06bcaed1-1077-4940-b5c2-6ac1a8f35024 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 22:57:07.128757 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-06bcaed1-1077-4940-b5c2-6ac1a8f35024 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 204 len: 0 microversion: 2.1 time: 0.357007 Jun 23 22:57:07.129358 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 577/1179] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 22:57:06 2022] DELETE /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 22:57:07.137427 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bf407782-8bb5-4871-9351-3cec3d72ee04 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:07.138048 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-bf407782-8bb5-4871-9351-3cec3d72ee04 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:07.144147 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bf407782-8bb5-4871-9351-3cec3d72ee04 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:07.144621 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bf407782-8bb5-4871-9351-3cec3d72ee04 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:07.145384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bf407782-8bb5-4871-9351-3cec3d72ee04 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:07.145820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bf407782-8bb5-4871-9351-3cec3d72ee04 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:07.272211 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-bf407782-8bb5-4871-9351-3cec3d72ee04 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:07.279818 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-bf407782-8bb5-4871-9351-3cec3d72ee04 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1471 microversion: 2.1 time: 0.146305 Jun 23 22:57:07.280384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 603/1180] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:07 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1471 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:07.955074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:57:07.955742 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Thu Jun 23 22:57:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 22:57:08.298371 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e98f4588-f3ad-4dde-9e61-941e348972fb tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:08.299076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e98f4588-f3ad-4dde-9e61-941e348972fb tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:08.306534 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e98f4588-f3ad-4dde-9e61-941e348972fb tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:08.306984 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e98f4588-f3ad-4dde-9e61-941e348972fb tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:08.307743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e98f4588-f3ad-4dde-9e61-941e348972fb tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:08.308180 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e98f4588-f3ad-4dde-9e61-941e348972fb tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:08.440176 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e98f4588-f3ad-4dde-9e61-941e348972fb tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:08.447815 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e98f4588-f3ad-4dde-9e61-941e348972fb tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1471 microversion: 2.1 time: 0.153673 Jun 23 22:57:08.448365 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 578/1181] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:08 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:08.993468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-ba79e4d8-9778-49e0-b3e7-6a4ea4774f1d req-a007dabd-1661-48b9-b0e2-3686e2341a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c87770-17a1-424f-b010-21dd54ef5e11", "name": "network-vif-deleted", "tag": "4242cf2c-7225-4374-b59e-afd9151baaa4"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:57:08.999558 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-ba79e4d8-9778-49e0-b3e7-6a4ea4774f1d req-a007dabd-1661-48b9-b0e2-3686e2341a61 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:09.000001 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-ba79e4d8-9778-49e0-b3e7-6a4ea4774f1d req-a007dabd-1661-48b9-b0e2-3686e2341a61 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:09.012180 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-ba79e4d8-9778-49e0-b3e7-6a4ea4774f1d req-a007dabd-1661-48b9-b0e2-3686e2341a61 service nova] Creating event network-vif-deleted:4242cf2c-7225-4374-b59e-afd9151baaa4 for instance f4c87770-17a1-424f-b010-21dd54ef5e11 on hv-cinder-81322 Jun 23 22:57:09.017189 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-ba79e4d8-9778-49e0-b3e7-6a4ea4774f1d req-a007dabd-1661-48b9-b0e2-3686e2341a61 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029845 Jun 23 22:57:09.021696 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 604/1182] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:57:09.465501 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:09.466122 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:09.472879 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:09.473322 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:09.474069 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:09.474503 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:09.505306 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:09.505747 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:09.506186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.objects.instance [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lazy-loading 'fault' on Instance uuid f4c87770-17a1-424f-b010-21dd54ef5e11 {{(pid=124725) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 22:57:09.545922 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d0c9e94f3854a37948f247ca8e09c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9c5c553b604f5a8f5a287782c998c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:09.554443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-de1d50aa-a882-4508-94f0-c6b5212af84b tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 200 len: 1305 microversion: 2.1 time: 0.092806 Jun 23 22:57:09.555012 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 579/1183] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:09 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 1305 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:10.572497 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:10.573142 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] [instance: f4c87770-17a1-424f-b010-21dd54ef5e11] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:10.579347 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:10.579802 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:10.580563 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:10.581025 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:10.594032 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] HTTP exception thrown: Instance f4c87770-17a1-424f-b010-21dd54ef5e11 could not be found. Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Request method failure captured: Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 HTTP/1.1 Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO-w4llHNc9DNvaezzIS4p_xVpyzTxyb2sat3UTsh1OTSofh2UPzuVk8BtpTogi1TsFIitm8NNitCMFHc9ioUgSvPGU0oXE9tVsUsFvynUIBHgd5JQ8xfEIJ30yyOLOn_w3HNhUCQlzBD4IAW6t_MHtLbbxRq4a7O2iyZefVQK5iL6M Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: 9e9c5c553b604f5a8f5a287782c998c7 Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-VolumesNegativeTest-662148438 Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 22:57:10.595922 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9e9c5c553b604f5a8f5a287782c998c7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9e9c5c553b604f5a8f5a287782c998c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9e9c5c553b604f5a8f5a287782c998c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9e9c5c553b604f5a8f5a287782c998c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-VolumesNegativeTest-662148438 Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: 9e9c5c553b604f5a8f5a287782c998c7 Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-VolumesNegativeTest-662148438 Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-VolumesNegativeTest-662148438-project Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: 4d0c9e94f3854a37948f247ca8e09c2a Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-VolumesNegativeTest-662148438-project Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance f4c87770-17a1-424f-b010-21dd54ef5e11 could not be found. Jun 23 22:57:10.598499 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': 'f4c87770-17a1-424f-b010-21dd54ef5e11'} Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c87770-17a1-424f-b010-21dd54ef5e11 could not be found. Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 22:57:10.599600 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c87770-17a1-424f-b010-21dd54ef5e11 could not be found. Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c87770-17a1-424f-b010-21dd54ef5e11 could not be found. Jun 23 22:57:10.601280 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 22:57:10.602778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] Returning 404 to user: Instance f4c87770-17a1-424f-b010-21dd54ef5e11 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 22:57:10.602778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-bb667833-f613-43db-b4c4-0d0167aeab48 tempest-VolumesNegativeTest-662148438 tempest-VolumesNegativeTest-662148438-project] 10.222.0.33 "GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11" status: 404 len: 111 microversion: 2.1 time: 0.030118 Jun 23 22:57:10.602778 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 605/1184] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:10 2022] GET /compute/v2.1/servers/f4c87770-17a1-424f-b010-21dd54ef5e11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 22:57:28.667818 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:28.668483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:28.885709 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a2572fb9-73e7-4069-a8e7-e10dd984fe73 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Action: 'create', calling method: .version_select at 0x7fbbcabcc430>, body: {"keypair": {"name": "tempest-TestShelveInstance-818210174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJM9VmNkpPQpedDi1iZZkRCnzGV8xV0bVntjSsCQq8v9lhdd3K1hoeDOFAv7V4/PXGQtyxlLZEX4yb2C5kBRdk09eNB+Og1QfPHOJR9CpBvGs4eXr5okd84Opf+kY/UaA=="}} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:57:28.903834 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-a2572fb9-73e7-4069-a8e7-e10dd984fe73 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Getting quotas for project c0a4f134a1b6433c8e3afade85914537. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:57:28.907872 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.quota [None req-a2572fb9-73e7-4069-a8e7-e10dd984fe73 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Getting quotas for user f32ae651a9ef4937a74bf87b1689043f and project c0a4f134a1b6433c8e3afade85914537. Resources: {'key_pairs'} {{(pid=124725) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:57:28.922230 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a2572fb9-73e7-4069-a8e7-e10dd984fe73 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [cad3d791-aff8-4c54-9c3c-1aa3ac8db4e3] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 22:57:29.929186 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [None req-a2572fb9-73e7-4069-a8e7-e10dd984fe73 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [cad3d791-aff8-4c54-9c3c-1aa3ac8db4e3] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34350. Jun 23 22:57:30.004963 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a2572fb9-73e7-4069-a8e7-e10dd984fe73 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.342129 Jun 23 22:57:30.006449 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 580/1185] 10.222.0.33 () {60 vars in 1158 bytes} [Thu Jun 23 22:57:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:57:47.803809 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1791323915", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-818210174", "security_groups": [{"name": "tempest-secgroup-smoke-816330006"}], "networks": [{"uuid": "8a476c4f-20b8-4e48-a7fc-fbe541b914cd"}], "block_device_mapping_v2": [{"uuid": "bd1699bb-b277-41a5-9373-47f61bc293ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:57:47.812155 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=31 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:47.812835 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=47 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:47.916157 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.network.neutron [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] validate_networks() for [('8a476c4f-20b8-4e48-a7fc-fbe541b914cd', None, None, None, None, None)] {{(pid=124724) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 22:57:48.404298 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Flavor limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 22:57:48.404761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Image limits 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 22:57:48.405230 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Flavor pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 22:57:48.405634 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Image pref 0:0:0 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 22:57:48.406039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.virt.hardware [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 22:57:48.415734 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:48.416236 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:48.417071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:48.417480 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:48.434474 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Getting quotas for project c0a4f134a1b6433c8e3afade85914537. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 22:57:48.438384 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.quota [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Getting quotas for user f32ae651a9ef4937a74bf87b1689043f and project c0a4f134a1b6433c8e3afade85914537. Resources: {'cores', 'instances', 'ram'} {{(pid=124724) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 22:57:48.496675 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Going to run 1 instances... {{(pid=124724) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 22:57:48.498789 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bd1699bb-b277-41a5-9373-47f61bc293ae',volume_size=None,volume_type=None)] {{(pid=124724) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 22:57:48.845577 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-0e11340c-9a9f-44a6-a063-3c5f5dfae79b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.046088 Jun 23 22:57:48.846573 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 606/1186] 10.222.0.33 () {60 vars in 1146 bytes} [Thu Jun 23 22:57:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 22:57:48.853508 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=4 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:48.854315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:48.858491 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5e3f562f-bc78-401b-81e6-1cfee66fa342 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:48.859104 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5e3f562f-bc78-401b-81e6-1cfee66fa342 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:48.915798 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5e3f562f-bc78-401b-81e6-1cfee66fa342 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:48.922826 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5e3f562f-bc78-401b-81e6-1cfee66fa342 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1088 microversion: 2.1 time: 0.070611 Jun 23 22:57:48.923473 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 581/1187] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:48 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:49.941256 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e298c993-985a-4602-a6dc-5c61c999c62b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:49.941990 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e298c993-985a-4602-a6dc-5c61c999c62b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:49.948488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e298c993-985a-4602-a6dc-5c61c999c62b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:49.949074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e298c993-985a-4602-a6dc-5c61c999c62b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:49.949826 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e298c993-985a-4602-a6dc-5c61c999c62b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:49.950283 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e298c993-985a-4602-a6dc-5c61c999c62b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:50.011397 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e298c993-985a-4602-a6dc-5c61c999c62b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:50.018971 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e298c993-985a-4602-a6dc-5c61c999c62b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1138 microversion: 2.1 time: 0.081712 Jun 23 22:57:50.023472 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 607/1188] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:49 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:51.037280 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-64079c9c-f3c2-4fa9-bdc8-7a881b5c0ede tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:51.037994 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-64079c9c-f3c2-4fa9-bdc8-7a881b5c0ede tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:51.045352 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64079c9c-f3c2-4fa9-bdc8-7a881b5c0ede tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:51.045811 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64079c9c-f3c2-4fa9-bdc8-7a881b5c0ede tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:51.046592 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64079c9c-f3c2-4fa9-bdc8-7a881b5c0ede tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:51.047030 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-64079c9c-f3c2-4fa9-bdc8-7a881b5c0ede tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:51.129743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-64079c9c-f3c2-4fa9-bdc8-7a881b5c0ede tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:51.137881 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-64079c9c-f3c2-4fa9-bdc8-7a881b5c0ede tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1204 microversion: 2.1 time: 0.105254 Jun 23 22:57:51.141300 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 582/1189] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:51 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1204 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 22:57:52.155840 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-50a2512a-d520-4349-9ac1-449c8cca4e39 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:52.156468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-50a2512a-d520-4349-9ac1-449c8cca4e39 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:52.163955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-50a2512a-d520-4349-9ac1-449c8cca4e39 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:52.164406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-50a2512a-d520-4349-9ac1-449c8cca4e39 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:52.165201 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-50a2512a-d520-4349-9ac1-449c8cca4e39 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:52.165635 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-50a2512a-d520-4349-9ac1-449c8cca4e39 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:52.322590 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-50a2512a-d520-4349-9ac1-449c8cca4e39 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:52.341664 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-50a2512a-d520-4349-9ac1-449c8cca4e39 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1271 microversion: 2.1 time: 0.183488 Jun 23 22:57:52.341664 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 608/1190] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:52 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:52.921625 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-84e50d12-aba1-4260-b50f-afaafdfe5f55 req-2f9ce8e9-1370-47d0-a6dc-acfbb87e3857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1133ea80-f77a-40c6-8f3b-a0701e0acd61", "tag": "6edf4080-938a-4635-9a2c-e4b1522c4b6c"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:57:52.930988 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-84e50d12-aba1-4260-b50f-afaafdfe5f55 req-2f9ce8e9-1370-47d0-a6dc-acfbb87e3857 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:52.931438 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-84e50d12-aba1-4260-b50f-afaafdfe5f55 req-2f9ce8e9-1370-47d0-a6dc-acfbb87e3857 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:52.944222 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-84e50d12-aba1-4260-b50f-afaafdfe5f55 req-2f9ce8e9-1370-47d0-a6dc-acfbb87e3857 service nova] Creating event network-changed:6edf4080-938a-4635-9a2c-e4b1522c4b6c for instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 on hv-cinder-81322 Jun 23 22:57:52.949566 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-84e50d12-aba1-4260-b50f-afaafdfe5f55 req-2f9ce8e9-1370-47d0-a6dc-acfbb87e3857 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032451 Jun 23 22:57:52.950212 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 583/1191] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:57:53.354271 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3eef641c-6be8-4ba5-a990-adc7a224ebf6 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:53.354880 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3eef641c-6be8-4ba5-a990-adc7a224ebf6 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:53.361338 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3eef641c-6be8-4ba5-a990-adc7a224ebf6 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:53.362099 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3eef641c-6be8-4ba5-a990-adc7a224ebf6 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:53.362903 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3eef641c-6be8-4ba5-a990-adc7a224ebf6 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:53.364091 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3eef641c-6be8-4ba5-a990-adc7a224ebf6 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:53.496315 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3eef641c-6be8-4ba5-a990-adc7a224ebf6 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:53.504018 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3eef641c-6be8-4ba5-a990-adc7a224ebf6 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.153583 Jun 23 22:57:53.504601 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 609/1192] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:53 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:54.521914 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-785d80b0-199d-4590-8d4b-e830f38c4157 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:54.522609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-785d80b0-199d-4590-8d4b-e830f38c4157 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:54.528844 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-785d80b0-199d-4590-8d4b-e830f38c4157 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:54.529289 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-785d80b0-199d-4590-8d4b-e830f38c4157 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:54.530038 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-785d80b0-199d-4590-8d4b-e830f38c4157 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:54.530471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-785d80b0-199d-4590-8d4b-e830f38c4157 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:54.658073 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-785d80b0-199d-4590-8d4b-e830f38c4157 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:54.665497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-785d80b0-199d-4590-8d4b-e830f38c4157 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.148187 Jun 23 22:57:54.666055 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 584/1193] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:54 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:55.682108 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-04052cdb-0cc3-4c58-bacb-ca163617128e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:55.682648 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-04052cdb-0cc3-4c58-bacb-ca163617128e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:55.689395 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-04052cdb-0cc3-4c58-bacb-ca163617128e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:55.689850 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-04052cdb-0cc3-4c58-bacb-ca163617128e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:55.690608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-04052cdb-0cc3-4c58-bacb-ca163617128e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:55.691208 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-04052cdb-0cc3-4c58-bacb-ca163617128e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:55.817935 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-04052cdb-0cc3-4c58-bacb-ca163617128e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:55.825427 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-04052cdb-0cc3-4c58-bacb-ca163617128e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.147239 Jun 23 22:57:55.825986 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 610/1194] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:55 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:56.842312 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-bf8ae828-7d9d-4056-965c-275a97b6af8e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:56.842922 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-bf8ae828-7d9d-4056-965c-275a97b6af8e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:56.849489 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf8ae828-7d9d-4056-965c-275a97b6af8e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:56.855694 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf8ae828-7d9d-4056-965c-275a97b6af8e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:56.855694 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf8ae828-7d9d-4056-965c-275a97b6af8e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:56.855694 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-bf8ae828-7d9d-4056-965c-275a97b6af8e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:56.983134 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-bf8ae828-7d9d-4056-965c-275a97b6af8e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:56.991304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-bf8ae828-7d9d-4056-965c-275a97b6af8e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.153005 Jun 23 22:57:56.991866 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 585/1195] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:56 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:58.008389 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-655c8001-3816-4f19-b02d-1e87b257ebcb tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:58.009005 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-655c8001-3816-4f19-b02d-1e87b257ebcb tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:58.015486 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-655c8001-3816-4f19-b02d-1e87b257ebcb tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:58.015925 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-655c8001-3816-4f19-b02d-1e87b257ebcb tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:58.016698 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-655c8001-3816-4f19-b02d-1e87b257ebcb tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:58.017137 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-655c8001-3816-4f19-b02d-1e87b257ebcb tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:58.149262 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-655c8001-3816-4f19-b02d-1e87b257ebcb tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:58.157939 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-655c8001-3816-4f19-b02d-1e87b257ebcb tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.153897 Jun 23 22:57:58.158498 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 611/1196] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:58 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:57:59.175119 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ea4f6158-1761-4a84-95d6-3cd5716c4e29 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:57:59.175636 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ea4f6158-1761-4a84-95d6-3cd5716c4e29 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:57:59.178825 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell0:SELECT=2 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:57:59.183609 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea4f6158-1761-4a84-95d6-3cd5716c4e29 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:59.184053 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea4f6158-1761-4a84-95d6-3cd5716c4e29 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:59.184827 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea4f6158-1761-4a84-95d6-3cd5716c4e29 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:57:59.193788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ea4f6158-1761-4a84-95d6-3cd5716c4e29 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:57:59.315414 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ea4f6158-1761-4a84-95d6-3cd5716c4e29 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:57:59.323237 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ea4f6158-1761-4a84-95d6-3cd5716c4e29 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.152006 Jun 23 22:57:59.324720 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 586/1197] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:57:59 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:00.339833 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e4a34a5e-5d1f-46f9-9791-6c1ffc7d9ae3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:58:00.340442 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e4a34a5e-5d1f-46f9-9791-6c1ffc7d9ae3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:58:00.342310 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:58:00.343215 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell0:SELECT=6 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 22:58:00.349090 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4a34a5e-5d1f-46f9-9791-6c1ffc7d9ae3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:00.349538 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4a34a5e-5d1f-46f9-9791-6c1ffc7d9ae3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:00.350333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4a34a5e-5d1f-46f9-9791-6c1ffc7d9ae3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:00.350765 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e4a34a5e-5d1f-46f9-9791-6c1ffc7d9ae3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:00.480351 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e4a34a5e-5d1f-46f9-9791-6c1ffc7d9ae3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:58:00.487735 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e4a34a5e-5d1f-46f9-9791-6c1ffc7d9ae3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.151747 Jun 23 22:58:00.488294 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 612/1198] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:58:00 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:01.505259 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-6dbc1f02-c525-46c6-b7b2-e01ae5557dfd tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:58:01.505920 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-6dbc1f02-c525-46c6-b7b2-e01ae5557dfd tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:58:01.512735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6dbc1f02-c525-46c6-b7b2-e01ae5557dfd tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:01.513181 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6dbc1f02-c525-46c6-b7b2-e01ae5557dfd tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:01.513931 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6dbc1f02-c525-46c6-b7b2-e01ae5557dfd tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:01.514360 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-6dbc1f02-c525-46c6-b7b2-e01ae5557dfd tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:01.649204 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-6dbc1f02-c525-46c6-b7b2-e01ae5557dfd tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:58:01.656932 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-6dbc1f02-c525-46c6-b7b2-e01ae5557dfd tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.156202 Jun 23 22:58:01.657545 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 587/1199] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:58:01 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:02.674304 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-881f143e-a8b0-4976-ab93-38ceb238a416 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:58:02.674912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-881f143e-a8b0-4976-ab93-38ceb238a416 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:58:02.682478 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-881f143e-a8b0-4976-ab93-38ceb238a416 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:02.682926 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-881f143e-a8b0-4976-ab93-38ceb238a416 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:02.683761 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-881f143e-a8b0-4976-ab93-38ceb238a416 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:02.684223 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-881f143e-a8b0-4976-ab93-38ceb238a416 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:02.821185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-881f143e-a8b0-4976-ab93-38ceb238a416 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:58:02.829052 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-881f143e-a8b0-4976-ab93-38ceb238a416 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.158810 Jun 23 22:58:02.829609 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 613/1200] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:58:02 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:03.846737 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a3af9fd2-0f64-45f7-8888-813c779065a2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:58:03.847346 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a3af9fd2-0f64-45f7-8888-813c779065a2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:58:03.854661 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3af9fd2-0f64-45f7-8888-813c779065a2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:03.855105 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3af9fd2-0f64-45f7-8888-813c779065a2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:03.855852 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3af9fd2-0f64-45f7-8888-813c779065a2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:03.856281 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a3af9fd2-0f64-45f7-8888-813c779065a2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:03.982416 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a3af9fd2-0f64-45f7-8888-813c779065a2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:58:03.990479 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a3af9fd2-0f64-45f7-8888-813c779065a2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.147928 Jun 23 22:58:03.991035 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 588/1201] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:58:03 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:04.845151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-091f32b8-8853-4202-b637-b0ad4972f556 req-6e0a21fd-597e-4543-a812-89b153c523f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1133ea80-f77a-40c6-8f3b-a0701e0acd61", "name": "network-vif-plugged", "status": "completed", "tag": "6edf4080-938a-4635-9a2c-e4b1522c4b6c"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:58:04.853918 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-091f32b8-8853-4202-b637-b0ad4972f556 req-6e0a21fd-597e-4543-a812-89b153c523f4 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:04.854357 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-091f32b8-8853-4202-b637-b0ad4972f556 req-6e0a21fd-597e-4543-a812-89b153c523f4 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:04.865071 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-091f32b8-8853-4202-b637-b0ad4972f556 req-6e0a21fd-597e-4543-a812-89b153c523f4 service nova] Creating event network-vif-plugged:6edf4080-938a-4635-9a2c-e4b1522c4b6c for instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 on hv-cinder-81322 Jun 23 22:58:04.870243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-091f32b8-8853-4202-b637-b0ad4972f556 req-6e0a21fd-597e-4543-a812-89b153c523f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029158 Jun 23 22:58:04.870794 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 614/1202] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:58:05.007743 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ab8f2c52-6617-4195-b8a0-866ae1b4b449 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:58:05.008406 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ab8f2c52-6617-4195-b8a0-866ae1b4b449 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:58:05.014973 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab8f2c52-6617-4195-b8a0-866ae1b4b449 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:05.015426 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab8f2c52-6617-4195-b8a0-866ae1b4b449 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:05.016180 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab8f2c52-6617-4195-b8a0-866ae1b4b449 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:05.016642 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ab8f2c52-6617-4195-b8a0-866ae1b4b449 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:05.150022 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ab8f2c52-6617-4195-b8a0-866ae1b4b449 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:58:05.158488 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ab8f2c52-6617-4195-b8a0-866ae1b4b449 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.155358 Jun 23 22:58:05.159068 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 589/1203] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:58:05 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:06.177346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-6f33db1b-289d-406d-a542-36500df49761 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:58:06.178074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-6f33db1b-289d-406d-a542-36500df49761 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:58:06.184192 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6f33db1b-289d-406d-a542-36500df49761 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:06.190134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6f33db1b-289d-406d-a542-36500df49761 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:06.190134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6f33db1b-289d-406d-a542-36500df49761 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:06.190134 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-6f33db1b-289d-406d-a542-36500df49761 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:06.334188 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-6f33db1b-289d-406d-a542-36500df49761 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:58:06.341846 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-6f33db1b-289d-406d-a542-36500df49761 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1259 microversion: 2.1 time: 0.170112 Jun 23 22:58:06.342407 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 615/1204] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:58:06 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:07.359565 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4f38ab6d-ab02-467c-8773-7f9ca885241d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:58:07.360176 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4f38ab6d-ab02-467c-8773-7f9ca885241d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:58:07.367458 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4f38ab6d-ab02-467c-8773-7f9ca885241d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:07.367883 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4f38ab6d-ab02-467c-8773-7f9ca885241d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:07.368663 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4f38ab6d-ab02-467c-8773-7f9ca885241d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:07.369101 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4f38ab6d-ab02-467c-8773-7f9ca885241d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:07.494864 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4f38ab6d-ab02-467c-8773-7f9ca885241d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:58:07.502357 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4f38ab6d-ab02-467c-8773-7f9ca885241d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1442 microversion: 2.1 time: 0.146646 Jun 23 22:58:07.502929 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 590/1205] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:58:07 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1442 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:07.519369 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-66c29281-5c73-4b4f-a218-c825591ea49b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 22:58:07.519989 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-66c29281-5c73-4b4f-a218-c825591ea49b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 22:58:07.526468 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-66c29281-5c73-4b4f-a218-c825591ea49b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:07.526948 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-66c29281-5c73-4b4f-a218-c825591ea49b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:07.527711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-66c29281-5c73-4b4f-a218-c825591ea49b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:07.528183 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-66c29281-5c73-4b4f-a218-c825591ea49b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:07.656048 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-66c29281-5c73-4b4f-a218-c825591ea49b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 22:58:07.664350 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-66c29281-5c73-4b4f-a218-c825591ea49b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1442 microversion: 2.1 time: 0.148839 Jun 23 22:58:07.664941 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 616/1206] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 22:58:07 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1442 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 22:58:09.896770 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-51f04b0a-e32b-4257-870f-55e9c1b3f1e3 req-51f06e7a-0181-4489-a721-fce309373077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1133ea80-f77a-40c6-8f3b-a0701e0acd61", "tag": "6edf4080-938a-4635-9a2c-e4b1522c4b6c"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 22:58:09.904969 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-51f04b0a-e32b-4257-870f-55e9c1b3f1e3 req-51f06e7a-0181-4489-a721-fce309373077 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 22:58:09.905497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-51f04b0a-e32b-4257-870f-55e9c1b3f1e3 req-51f06e7a-0181-4489-a721-fce309373077 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 22:58:09.917908 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.compute.server_external_events [req-51f04b0a-e32b-4257-870f-55e9c1b3f1e3 req-51f06e7a-0181-4489-a721-fce309373077 service nova] Creating event network-changed:6edf4080-938a-4635-9a2c-e4b1522c4b6c for instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 on hv-cinder-81322 Jun 23 22:58:09.923852 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-51f04b0a-e32b-4257-870f-55e9c1b3f1e3 req-51f06e7a-0181-4489-a721-fce309373077 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093547 Jun 23 22:58:09.924463 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 591/1207] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 22:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 22:58:37.003456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 22:58:37.003456 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Thu Jun 23 22:58:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 23:00:03.954863 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:00:03.955624 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=58 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:00:03.960106 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cbd6f5bf-2aac-412e-b4fb-c68ee0d991e9 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 23:00:03.960649 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cbd6f5bf-2aac-412e-b4fb-c68ee0d991e9 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:03.966711 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cbd6f5bf-2aac-412e-b4fb-c68ee0d991e9 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:03.967154 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cbd6f5bf-2aac-412e-b4fb-c68ee0d991e9 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:03.967902 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cbd6f5bf-2aac-412e-b4fb-c68ee0d991e9 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:03.968333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cbd6f5bf-2aac-412e-b4fb-c68ee0d991e9 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:03.991250 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.objects.instance [None req-cbd6f5bf-2aac-412e-b4fb-c68ee0d991e9 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lazy-loading 'flavor' on Instance uuid 1133ea80-f77a-40c6-8f3b-a0701e0acd61 {{(pid=124724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 23:00:04.229346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cbd6f5bf-2aac-412e-b4fb-c68ee0d991e9 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "POST /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61/action" status: 202 len: 0 microversion: 2.1 time: 0.275783 Jun 23 23:00:04.229900 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 617/1208] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 23:00:03 2022] POST /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 23:00:04.242967 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=24 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:00:04.244456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=52 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:00:04.248652 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-676cfd95-e45c-4a1c-bf4a-ebd068f8b20d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:04.249425 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-676cfd95-e45c-4a1c-bf4a-ebd068f8b20d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:04.255557 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-676cfd95-e45c-4a1c-bf4a-ebd068f8b20d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:04.256063 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-676cfd95-e45c-4a1c-bf4a-ebd068f8b20d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:04.257103 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-676cfd95-e45c-4a1c-bf4a-ebd068f8b20d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:04.257540 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-676cfd95-e45c-4a1c-bf4a-ebd068f8b20d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:04.390004 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-676cfd95-e45c-4a1c-bf4a-ebd068f8b20d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:04.397569 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-676cfd95-e45c-4a1c-bf4a-ebd068f8b20d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.156878 Jun 23 23:00:04.398124 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 592/1209] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:04 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:05.417608 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-59139095-0764-446d-9553-2550dd7793ef tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:05.418306 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-59139095-0764-446d-9553-2550dd7793ef tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:05.424516 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-59139095-0764-446d-9553-2550dd7793ef tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:05.424987 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-59139095-0764-446d-9553-2550dd7793ef tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:05.425735 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-59139095-0764-446d-9553-2550dd7793ef tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:05.426165 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-59139095-0764-446d-9553-2550dd7793ef tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:05.559500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-59139095-0764-446d-9553-2550dd7793ef tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:05.566946 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-59139095-0764-446d-9553-2550dd7793ef tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.155327 Jun 23 23:00:05.567494 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 618/1210] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:05 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:06.585158 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-d10420f6-a62a-4425-bbdb-847ca3fc6f3e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:06.585788 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-d10420f6-a62a-4425-bbdb-847ca3fc6f3e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:06.592566 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d10420f6-a62a-4425-bbdb-847ca3fc6f3e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:06.593035 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d10420f6-a62a-4425-bbdb-847ca3fc6f3e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:06.593779 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d10420f6-a62a-4425-bbdb-847ca3fc6f3e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:06.594213 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-d10420f6-a62a-4425-bbdb-847ca3fc6f3e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:06.720122 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-d10420f6-a62a-4425-bbdb-847ca3fc6f3e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:06.727963 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-d10420f6-a62a-4425-bbdb-847ca3fc6f3e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.147365 Jun 23 23:00:06.728529 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 593/1211] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:06 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:07.744799 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-1ea8a9b1-ee1e-4bf5-914c-beeb5fba8e27 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:07.745428 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-1ea8a9b1-ee1e-4bf5-914c-beeb5fba8e27 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:07.751891 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1ea8a9b1-ee1e-4bf5-914c-beeb5fba8e27 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:07.752340 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1ea8a9b1-ee1e-4bf5-914c-beeb5fba8e27 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:07.753163 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1ea8a9b1-ee1e-4bf5-914c-beeb5fba8e27 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:07.753599 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-1ea8a9b1-ee1e-4bf5-914c-beeb5fba8e27 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:07.886029 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-1ea8a9b1-ee1e-4bf5-914c-beeb5fba8e27 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:07.893496 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-1ea8a9b1-ee1e-4bf5-914c-beeb5fba8e27 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.152624 Jun 23 23:00:07.894049 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 619/1212] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:07 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:08.909699 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-ce05c8f7-6d50-49dc-901a-55aec00473b4 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:08.910304 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-ce05c8f7-6d50-49dc-901a-55aec00473b4 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:08.917276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce05c8f7-6d50-49dc-901a-55aec00473b4 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:08.917725 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce05c8f7-6d50-49dc-901a-55aec00473b4 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:08.918471 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce05c8f7-6d50-49dc-901a-55aec00473b4 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:08.918901 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-ce05c8f7-6d50-49dc-901a-55aec00473b4 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:09.124167 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-ce05c8f7-6d50-49dc-901a-55aec00473b4 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:09.131755 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-ce05c8f7-6d50-49dc-901a-55aec00473b4 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.225871 Jun 23 23:00:09.132315 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 594/1213] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:08 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:10.148820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-cb6f1a2c-57c3-431a-baa0-f4088e535a45 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:10.149508 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-cb6f1a2c-57c3-431a-baa0-f4088e535a45 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:10.155734 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cb6f1a2c-57c3-431a-baa0-f4088e535a45 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:10.156257 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cb6f1a2c-57c3-431a-baa0-f4088e535a45 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:10.157049 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cb6f1a2c-57c3-431a-baa0-f4088e535a45 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:10.157486 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-cb6f1a2c-57c3-431a-baa0-f4088e535a45 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:10.287358 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-cb6f1a2c-57c3-431a-baa0-f4088e535a45 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:10.294955 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-cb6f1a2c-57c3-431a-baa0-f4088e535a45 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.150113 Jun 23 23:00:10.298196 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 620/1214] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:10 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:11.312652 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-5bbe46c5-af4b-4999-bd52-70eb66d2c80e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:11.313264 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-5bbe46c5-af4b-4999-bd52-70eb66d2c80e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:11.320334 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5bbe46c5-af4b-4999-bd52-70eb66d2c80e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:11.320807 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5bbe46c5-af4b-4999-bd52-70eb66d2c80e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:11.321556 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5bbe46c5-af4b-4999-bd52-70eb66d2c80e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:11.321989 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-5bbe46c5-af4b-4999-bd52-70eb66d2c80e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:11.448764 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-5bbe46c5-af4b-4999-bd52-70eb66d2c80e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:11.456202 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-5bbe46c5-af4b-4999-bd52-70eb66d2c80e tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.147447 Jun 23 23:00:11.456799 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 595/1215] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:11 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:12.474058 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-09dada0b-0904-4033-9041-052841b011b5 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:12.474813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-09dada0b-0904-4033-9041-052841b011b5 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:12.481389 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-09dada0b-0904-4033-9041-052841b011b5 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:12.481843 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-09dada0b-0904-4033-9041-052841b011b5 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:12.482592 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-09dada0b-0904-4033-9041-052841b011b5 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:12.483027 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-09dada0b-0904-4033-9041-052841b011b5 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:12.617114 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-09dada0b-0904-4033-9041-052841b011b5 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:12.624792 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-09dada0b-0904-4033-9041-052841b011b5 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.154516 Jun 23 23:00:12.625349 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 621/1216] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:12 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:13.641599 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-a532694e-2b89-4894-9afa-d685976e1784 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:13.642149 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-a532694e-2b89-4894-9afa-d685976e1784 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:13.649367 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a532694e-2b89-4894-9afa-d685976e1784 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:13.649812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a532694e-2b89-4894-9afa-d685976e1784 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:13.650564 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a532694e-2b89-4894-9afa-d685976e1784 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:13.650999 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-a532694e-2b89-4894-9afa-d685976e1784 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:13.782239 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-a532694e-2b89-4894-9afa-d685976e1784 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:13.790129 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-a532694e-2b89-4894-9afa-d685976e1784 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.152531 Jun 23 23:00:13.790693 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 596/1217] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:13 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:14.807632 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-547d5187-797c-4097-bcd7-16901f49bf81 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:14.808461 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-547d5187-797c-4097-bcd7-16901f49bf81 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:14.814994 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-547d5187-797c-4097-bcd7-16901f49bf81 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:14.815444 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-547d5187-797c-4097-bcd7-16901f49bf81 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:14.816200 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-547d5187-797c-4097-bcd7-16901f49bf81 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:14.816680 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-547d5187-797c-4097-bcd7-16901f49bf81 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:14.947464 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-547d5187-797c-4097-bcd7-16901f49bf81 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:14.955259 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-547d5187-797c-4097-bcd7-16901f49bf81 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.151631 Jun 23 23:00:14.955820 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 622/1218] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:14 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:15.972497 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-528e4f3f-355c-4354-9939-477271655565 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:15.973112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-528e4f3f-355c-4354-9939-477271655565 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:15.980241 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-528e4f3f-355c-4354-9939-477271655565 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:15.980715 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-528e4f3f-355c-4354-9939-477271655565 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:15.981462 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-528e4f3f-355c-4354-9939-477271655565 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:15.981897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-528e4f3f-355c-4354-9939-477271655565 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:16.108542 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-528e4f3f-355c-4354-9939-477271655565 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:16.116065 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-528e4f3f-355c-4354-9939-477271655565 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.147467 Jun 23 23:00:16.116634 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 597/1219] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:15 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:17.132044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-e8a9349c-b2fa-4388-8800-59d1babf9d6d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:17.132768 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-e8a9349c-b2fa-4388-8800-59d1babf9d6d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:17.139614 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8a9349c-b2fa-4388-8800-59d1babf9d6d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:17.140064 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8a9349c-b2fa-4388-8800-59d1babf9d6d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:17.140912 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8a9349c-b2fa-4388-8800-59d1babf9d6d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:17.141353 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-e8a9349c-b2fa-4388-8800-59d1babf9d6d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:17.276837 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-e8a9349c-b2fa-4388-8800-59d1babf9d6d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:17.284414 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-e8a9349c-b2fa-4388-8800-59d1babf9d6d tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.156221 Jun 23 23:00:17.284982 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 623/1220] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:17 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:18.302655 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-e0df3da6-0691-4576-8af1-43c08b50f31b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:18.303256 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-e0df3da6-0691-4576-8af1-43c08b50f31b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:18.309694 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0df3da6-0691-4576-8af1-43c08b50f31b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:18.310137 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0df3da6-0691-4576-8af1-43c08b50f31b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:18.310885 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0df3da6-0691-4576-8af1-43c08b50f31b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:18.311318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-e0df3da6-0691-4576-8af1-43c08b50f31b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:18.438812 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-e0df3da6-0691-4576-8af1-43c08b50f31b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:18.447507 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-e0df3da6-0691-4576-8af1-43c08b50f31b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1508 microversion: 2.1 time: 0.149319 Jun 23 23:00:18.448071 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 598/1221] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:18 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:18.463704 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 23:00:18.464309 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:18.470813 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:18.471269 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:18.472031 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:18.472470 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:18.722318 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [94ffdc2d-f82d-4f15-b332-5dca53d3f5f1] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 23:00:19.730253 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [94ffdc2d-f82d-4f15-b332-5dca53d3f5f1] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34598. Jun 23 23:00:19.733427 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-8433022b-72f8-41f2-8c8a-b8493529ccb0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "POST /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61/action" status: 202 len: 0 microversion: 2.1 time: 1.273907 Jun 23 23:00:19.734329 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 624/1222] 10.222.0.33 () {60 vars in 1277 bytes} [Thu Jun 23 23:00:18 2022] POST /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61/action => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 23:00:19.742072 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-62cf38a5-3865-4f04-a55e-533f047deaa0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:19.742684 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-62cf38a5-3865-4f04-a55e-533f047deaa0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:19.749182 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62cf38a5-3865-4f04-a55e-533f047deaa0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:19.749697 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62cf38a5-3865-4f04-a55e-533f047deaa0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:19.750460 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62cf38a5-3865-4f04-a55e-533f047deaa0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:19.750897 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-62cf38a5-3865-4f04-a55e-533f047deaa0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:19.881267 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-62cf38a5-3865-4f04-a55e-533f047deaa0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:19.888939 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-62cf38a5-3865-4f04-a55e-533f047deaa0 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1516 microversion: 2.1 time: 0.150802 Jun 23 23:00:19.889509 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 599/1223] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:19 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:20.907526 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3c14860d-0cd0-4ca2-a06c-9650633a1fd8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:20.908072 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3c14860d-0cd0-4ca2-a06c-9650633a1fd8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:20.915355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3c14860d-0cd0-4ca2-a06c-9650633a1fd8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:20.915806 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3c14860d-0cd0-4ca2-a06c-9650633a1fd8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:20.916602 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3c14860d-0cd0-4ca2-a06c-9650633a1fd8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:20.917173 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3c14860d-0cd0-4ca2-a06c-9650633a1fd8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:21.049799 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3c14860d-0cd0-4ca2-a06c-9650633a1fd8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:21.057463 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3c14860d-0cd0-4ca2-a06c-9650633a1fd8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1518 microversion: 2.1 time: 0.154640 Jun 23 23:00:21.058019 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 625/1224] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:20 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:21.434460 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [req-f1cb1dae-84e5-4229-a340-c32c160387ba req-e7e34a94-6fa9-4da9-aea5-6ff881e564d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1133ea80-f77a-40c6-8f3b-a0701e0acd61", "name": "network-vif-unplugged", "status": "completed", "tag": "6edf4080-938a-4635-9a2c-e4b1522c4b6c"}]} {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 23:00:21.442679 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-f1cb1dae-84e5-4229-a340-c32c160387ba req-e7e34a94-6fa9-4da9-aea5-6ff881e564d7 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:21.443744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [req-f1cb1dae-84e5-4229-a340-c32c160387ba req-e7e34a94-6fa9-4da9-aea5-6ff881e564d7 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:21.454692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.compute.server_external_events [req-f1cb1dae-84e5-4229-a340-c32c160387ba req-e7e34a94-6fa9-4da9-aea5-6ff881e564d7 service nova] Unable to find a host for instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61. Dropping event network-vif-unplugged {{(pid=124725) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 23:00:21.455621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [req-f1cb1dae-84e5-4229-a340-c32c160387ba req-e7e34a94-6fa9-4da9-aea5-6ff881e564d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025091 Jun 23 23:00:21.456112 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 600/1225] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 23:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 23:00:22.074802 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-b7850ad4-e279-46c6-bcad-a2797d6551a1 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:22.075442 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-b7850ad4-e279-46c6-bcad-a2797d6551a1 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:22.082546 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b7850ad4-e279-46c6-bcad-a2797d6551a1 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:22.082936 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b7850ad4-e279-46c6-bcad-a2797d6551a1 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:22.084209 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b7850ad4-e279-46c6-bcad-a2797d6551a1 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:22.084672 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-b7850ad4-e279-46c6-bcad-a2797d6551a1 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:22.218458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-b7850ad4-e279-46c6-bcad-a2797d6551a1 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:22.226702 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-b7850ad4-e279-46c6-bcad-a2797d6551a1 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.155726 Jun 23 23:00:22.227267 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 626/1226] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:22 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:23.244141 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3822a16a-9395-418e-98b5-b82c436a7f8b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:23.244805 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3822a16a-9395-418e-98b5-b82c436a7f8b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:23.251228 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3822a16a-9395-418e-98b5-b82c436a7f8b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:23.251672 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3822a16a-9395-418e-98b5-b82c436a7f8b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:23.252418 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3822a16a-9395-418e-98b5-b82c436a7f8b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:23.252880 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3822a16a-9395-418e-98b5-b82c436a7f8b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:23.378793 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3822a16a-9395-418e-98b5-b82c436a7f8b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:23.386485 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3822a16a-9395-418e-98b5-b82c436a7f8b tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.146868 Jun 23 23:00:23.387047 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 601/1227] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:23 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:24.403033 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-730072cc-bcc7-42b1-8364-b6fe1ab6b8c8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:24.403642 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-730072cc-bcc7-42b1-8364-b6fe1ab6b8c8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:24.410168 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-730072cc-bcc7-42b1-8364-b6fe1ab6b8c8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:24.410613 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-730072cc-bcc7-42b1-8364-b6fe1ab6b8c8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:24.411398 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-730072cc-bcc7-42b1-8364-b6fe1ab6b8c8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:24.411834 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-730072cc-bcc7-42b1-8364-b6fe1ab6b8c8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:24.546660 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-730072cc-bcc7-42b1-8364-b6fe1ab6b8c8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:24.554676 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-730072cc-bcc7-42b1-8364-b6fe1ab6b8c8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.155429 Jun 23 23:00:24.555243 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 627/1228] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:24 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:25.571736 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-56c71c01-fc1a-4795-aafe-9cf4182e7169 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:25.572275 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-56c71c01-fc1a-4795-aafe-9cf4182e7169 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:25.578481 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56c71c01-fc1a-4795-aafe-9cf4182e7169 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:25.578933 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56c71c01-fc1a-4795-aafe-9cf4182e7169 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:25.579692 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56c71c01-fc1a-4795-aafe-9cf4182e7169 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:25.580130 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-56c71c01-fc1a-4795-aafe-9cf4182e7169 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:25.709621 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-56c71c01-fc1a-4795-aafe-9cf4182e7169 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:25.717408 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-56c71c01-fc1a-4795-aafe-9cf4182e7169 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.150116 Jun 23 23:00:25.717971 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 602/1229] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:25 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:26.735139 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-c46fc516-f87b-4f63-9a26-e02733e609d3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:26.735755 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-c46fc516-f87b-4f63-9a26-e02733e609d3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:26.742510 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c46fc516-f87b-4f63-9a26-e02733e609d3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:26.742960 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c46fc516-f87b-4f63-9a26-e02733e609d3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:26.743714 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c46fc516-f87b-4f63-9a26-e02733e609d3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:26.744151 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-c46fc516-f87b-4f63-9a26-e02733e609d3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:26.872533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-c46fc516-f87b-4f63-9a26-e02733e609d3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:26.880752 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-c46fc516-f87b-4f63-9a26-e02733e609d3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.148870 Jun 23 23:00:26.881453 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 628/1230] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:26 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:27.897849 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-355852ed-c492-4282-bd93-a81127ec574f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:27.898456 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-355852ed-c492-4282-bd93-a81127ec574f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:27.905219 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-355852ed-c492-4282-bd93-a81127ec574f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:27.905670 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-355852ed-c492-4282-bd93-a81127ec574f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:27.906417 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-355852ed-c492-4282-bd93-a81127ec574f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:27.906848 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-355852ed-c492-4282-bd93-a81127ec574f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:28.033698 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-355852ed-c492-4282-bd93-a81127ec574f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:28.042080 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-355852ed-c492-4282-bd93-a81127ec574f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.148136 Jun 23 23:00:28.042638 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 603/1231] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:27 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:29.059334 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4cf65f9c-26ad-42a2-b51f-6fbc18e4c1e3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:29.059876 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4cf65f9c-26ad-42a2-b51f-6fbc18e4c1e3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:29.066587 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4cf65f9c-26ad-42a2-b51f-6fbc18e4c1e3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:29.067039 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4cf65f9c-26ad-42a2-b51f-6fbc18e4c1e3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:29.068493 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4cf65f9c-26ad-42a2-b51f-6fbc18e4c1e3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:29.068963 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4cf65f9c-26ad-42a2-b51f-6fbc18e4c1e3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:29.199767 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-4cf65f9c-26ad-42a2-b51f-6fbc18e4c1e3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:29.207288 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4cf65f9c-26ad-42a2-b51f-6fbc18e4c1e3 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.152106 Jun 23 23:00:29.207860 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 629/1232] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:29 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:30.223297 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-4c4e9ca2-7d5b-470c-a550-8c20f052d038 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:30.224127 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-4c4e9ca2-7d5b-470c-a550-8c20f052d038 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:30.230612 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4c4e9ca2-7d5b-470c-a550-8c20f052d038 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:30.231056 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4c4e9ca2-7d5b-470c-a550-8c20f052d038 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:30.231809 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4c4e9ca2-7d5b-470c-a550-8c20f052d038 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:30.232240 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-4c4e9ca2-7d5b-470c-a550-8c20f052d038 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:30.366237 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-4c4e9ca2-7d5b-470c-a550-8c20f052d038 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:30.373755 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-4c4e9ca2-7d5b-470c-a550-8c20f052d038 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.154337 Jun 23 23:00:30.374319 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 604/1233] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:30 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:31.391460 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-f32632ea-e282-4363-a9b9-ea633fb72b11 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:31.392107 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-f32632ea-e282-4363-a9b9-ea633fb72b11 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:31.399355 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f32632ea-e282-4363-a9b9-ea633fb72b11 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:31.399805 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f32632ea-e282-4363-a9b9-ea633fb72b11 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:31.400557 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f32632ea-e282-4363-a9b9-ea633fb72b11 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:31.401006 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-f32632ea-e282-4363-a9b9-ea633fb72b11 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:31.419314 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:00:31.534421 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-f32632ea-e282-4363-a9b9-ea633fb72b11 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:31.546574 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-f32632ea-e282-4363-a9b9-ea633fb72b11 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.155283 Jun 23 23:00:31.546574 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 630/1234] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:31 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:32.560714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-7d8fa369-d919-47a7-8c2d-eca35d548608 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:32.561270 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-7d8fa369-d919-47a7-8c2d-eca35d548608 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:32.568734 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d8fa369-d919-47a7-8c2d-eca35d548608 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:32.569190 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d8fa369-d919-47a7-8c2d-eca35d548608 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:32.569961 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d8fa369-d919-47a7-8c2d-eca35d548608 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:32.570392 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-7d8fa369-d919-47a7-8c2d-eca35d548608 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:32.699173 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-7d8fa369-d919-47a7-8c2d-eca35d548608 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:32.706735 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-7d8fa369-d919-47a7-8c2d-eca35d548608 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.149978 Jun 23 23:00:32.707296 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 605/1235] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:32 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:33.563074 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-f9019e2c-9ff1-4d0d-8e36-2c860d32fe0c req-7d1b5ba3-2b72-4931-ac6d-2a515517d019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1133ea80-f77a-40c6-8f3b-a0701e0acd61", "name": "network-vif-plugged", "status": "completed", "tag": "6edf4080-938a-4635-9a2c-e4b1522c4b6c"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 23:00:33.573144 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-f9019e2c-9ff1-4d0d-8e36-2c860d32fe0c req-7d1b5ba3-2b72-4931-ac6d-2a515517d019 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:33.573737 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-f9019e2c-9ff1-4d0d-8e36-2c860d32fe0c req-7d1b5ba3-2b72-4931-ac6d-2a515517d019 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:33.585736 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-f9019e2c-9ff1-4d0d-8e36-2c860d32fe0c req-7d1b5ba3-2b72-4931-ac6d-2a515517d019 service nova] Creating event network-vif-plugged:6edf4080-938a-4635-9a2c-e4b1522c4b6c for instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 on hv-cinder-81322 Jun 23 23:00:33.591149 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-f9019e2c-9ff1-4d0d-8e36-2c860d32fe0c req-7d1b5ba3-2b72-4931-ac6d-2a515517d019 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032270 Jun 23 23:00:33.591745 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 631/1236] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 23:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 23:00:33.723410 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-fc074834-e9e3-4d5f-8fa0-b95a83f8f1db tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:33.724493 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-fc074834-e9e3-4d5f-8fa0-b95a83f8f1db tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:33.731990 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc074834-e9e3-4d5f-8fa0-b95a83f8f1db tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:33.732443 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc074834-e9e3-4d5f-8fa0-b95a83f8f1db tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:33.733276 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc074834-e9e3-4d5f-8fa0-b95a83f8f1db tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:33.733724 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-fc074834-e9e3-4d5f-8fa0-b95a83f8f1db tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:34.087606 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-fc074834-e9e3-4d5f-8fa0-b95a83f8f1db tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:34.095155 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-fc074834-e9e3-4d5f-8fa0-b95a83f8f1db tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1574 microversion: 2.1 time: 0.375735 Jun 23 23:00:34.095714 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 606/1237] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:33 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1574 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:35.112776 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-3fae383a-f1b5-44cd-ba91-7294325360f2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:00:35.113458 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-3fae383a-f1b5-44cd-ba91-7294325360f2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:00:35.115335 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=33 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:00:35.120523 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3fae383a-f1b5-44cd-ba91-7294325360f2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:35.121002 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3fae383a-f1b5-44cd-ba91-7294325360f2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:35.121760 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3fae383a-f1b5-44cd-ba91-7294325360f2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:00:35.122333 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-3fae383a-f1b5-44cd-ba91-7294325360f2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:00:35.251521 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-3fae383a-f1b5-44cd-ba91-7294325360f2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:00:35.259621 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-3fae383a-f1b5-44cd-ba91-7294325360f2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1561 microversion: 2.1 time: 0.152154 Jun 23 23:00:35.260185 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 632/1238] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:00:35 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:00:55.189002 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 23:00:55.190721 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Thu Jun 23 23:00:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 23:01:48.210667 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_api:SELECT=30 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:01:48.213973 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_api:SELECT=1 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:01:48.214712 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG dbcounter [-] [124724] Writing DB stats nova_cell1:SELECT=10 {{(pid=124724) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:01:48.219855 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG dbcounter [-] [124725] Writing DB stats nova_cell1:SELECT=86 {{(pid=124725) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 23:01:48.224039 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-86bfa483-5719-4e06-9bd4-342b7f6c652f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:01:48.224483 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86bfa483-5719-4e06-9bd4-342b7f6c652f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:01:48.231295 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86bfa483-5719-4e06-9bd4-342b7f6c652f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:48.231744 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86bfa483-5719-4e06-9bd4-342b7f6c652f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:48.232513 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86bfa483-5719-4e06-9bd4-342b7f6c652f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:48.232974 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-86bfa483-5719-4e06-9bd4-342b7f6c652f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:48.259626 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-86bfa483-5719-4e06-9bd4-342b7f6c652f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Going to try to terminate instance {{(pid=124725) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 23:01:48.292366 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-7921e753-1c08-4281-b5b1-b01782333645 req-750818d1-56eb-4708-8ab3-3c9587778ae1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1133ea80-f77a-40c6-8f3b-a0701e0acd61", "tag": "6edf4080-938a-4635-9a2c-e4b1522c4b6c"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 23:01:48.301362 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7921e753-1c08-4281-b5b1-b01782333645 req-750818d1-56eb-4708-8ab3-3c9587778ae1 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:48.301808 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-7921e753-1c08-4281-b5b1-b01782333645 req-750818d1-56eb-4708-8ab3-3c9587778ae1 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:48.312967 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-7921e753-1c08-4281-b5b1-b01782333645 req-750818d1-56eb-4708-8ab3-3c9587778ae1 service nova] Creating event network-changed:6edf4080-938a-4635-9a2c-e4b1522c4b6c for instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 on hv-cinder-81322 Jun 23 23:01:48.318061 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-7921e753-1c08-4281-b5b1-b01782333645 req-750818d1-56eb-4708-8ab3-3c9587778ae1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105508 Jun 23 23:01:48.318586 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 633/1239] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 23:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 23:01:48.518287 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-86bfa483-5719-4e06-9bd4-342b7f6c652f tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 204 len: 0 microversion: 2.1 time: 0.310049 Jun 23 23:01:48.519150 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 607/1240] 10.222.0.33 () {58 vars in 1238 bytes} [Thu Jun 23 23:01:48 2022] DELETE /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 23:01:48.528812 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-9a4877e6-6e5e-497a-ba99-a3d5607dad96 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:01:48.529500 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-9a4877e6-6e5e-497a-ba99-a3d5607dad96 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:01:48.536321 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9a4877e6-6e5e-497a-ba99-a3d5607dad96 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:48.538143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9a4877e6-6e5e-497a-ba99-a3d5607dad96 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:48.538143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9a4877e6-6e5e-497a-ba99-a3d5607dad96 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:48.538143 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-9a4877e6-6e5e-497a-ba99-a3d5607dad96 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:48.728052 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.policy [None req-9a4877e6-6e5e-497a-ba99-a3d5607dad96 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124724) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:01:48.735726 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-9a4877e6-6e5e-497a-ba99-a3d5607dad96 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.211187 Jun 23 23:01:48.736295 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 634/1241] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:01:48 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:01:49.753768 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-3d7a6642-d605-4246-9da4-6797c699b8f8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:01:49.754507 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-3d7a6642-d605-4246-9da4-6797c699b8f8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:01:49.762188 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d7a6642-d605-4246-9da4-6797c699b8f8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:49.762653 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d7a6642-d605-4246-9da4-6797c699b8f8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:49.763453 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d7a6642-d605-4246-9da4-6797c699b8f8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:49.763890 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-3d7a6642-d605-4246-9da4-6797c699b8f8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:49.909318 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-3d7a6642-d605-4246-9da4-6797c699b8f8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:01:49.917390 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-3d7a6642-d605-4246-9da4-6797c699b8f8 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1567 microversion: 2.1 time: 0.167941 Jun 23 23:01:49.917948 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 608/1242] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:01:49 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 23:01:50.435972 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [req-da537d57-631d-453c-b27a-ad7bc25fbe46 req-f9cd2086-9edf-4112-bb48-1c2f72b4b0e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1133ea80-f77a-40c6-8f3b-a0701e0acd61", "name": "network-vif-deleted", "tag": "6edf4080-938a-4635-9a2c-e4b1522c4b6c"}]} {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 23:01:50.440488 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-da537d57-631d-453c-b27a-ad7bc25fbe46 req-f9cd2086-9edf-4112-bb48-1c2f72b4b0e5 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:50.440981 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [req-da537d57-631d-453c-b27a-ad7bc25fbe46 req-f9cd2086-9edf-4112-bb48-1c2f72b4b0e5 service nova] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:50.452096 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.compute.server_external_events [req-da537d57-631d-453c-b27a-ad7bc25fbe46 req-f9cd2086-9edf-4112-bb48-1c2f72b4b0e5 service nova] Creating event network-vif-deleted:6edf4080-938a-4635-9a2c-e4b1522c4b6c for instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 on hv-cinder-81322 Jun 23 23:01:50.457418 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [req-da537d57-631d-453c-b27a-ad7bc25fbe46 req-f9cd2086-9edf-4112-bb48-1c2f72b4b0e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029626 Jun 23 23:01:50.458040 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 635/1243] 10.222.0.33 () {64 vars in 1317 bytes} [Thu Jun 23 23:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 23:01:50.934950 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dd5fa13e-8f4c-4496-b943-d739c3330ce2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:01:50.935560 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.compute.api [None req-dd5fa13e-8f4c-4496-b943-d739c3330ce2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124725) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:01:50.942076 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dd5fa13e-8f4c-4496-b943-d739c3330ce2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:50.942529 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dd5fa13e-8f4c-4496-b943-d739c3330ce2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:50.943289 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dd5fa13e-8f4c-4496-b943-d739c3330ce2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:50.944319 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG oslo_concurrency.lockutils [None req-dd5fa13e-8f4c-4496-b943-d739c3330ce2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124725) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:51.003659 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.policy [None req-dd5fa13e-8f4c-4496-b943-d739c3330ce2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32ae651a9ef4937a74bf87b1689043f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a4f134a1b6433c8e3afade85914537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124725) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 23:01:51.011767 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dd5fa13e-8f4c-4496-b943-d739c3330ce2 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 200 len: 1219 microversion: 2.1 time: 0.080673 Jun 23 23:01:51.012325 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 609/1244] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:01:50 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 23:01:52.029758 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '>' {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:01:52.030459 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.compute.api [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [instance: 1133ea80-f77a-40c6-8f3b-a0701e0acd61] Fetching instance by UUID {{(pid=124724) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 23:01:52.036896 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:52.037346 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:52.038097 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 23:01:52.038533 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG oslo_concurrency.lockutils [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Lock "5f0b80a3-fbde-406f-b6e6-3de0c437540c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124724) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 23:01:52.052277 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.wsgi [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] HTTP exception thrown: Instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 could not be found. Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Request method failure captured: Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: request: GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 HTTP/1.1 Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept: application/json Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Accept-Encoding: identity Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Connection: close Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Length: 0 Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Content-Type: application/json Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Host: 10.222.0.33 Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Openstack-System-Scope: None Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: User-Agent: python-urllib3/1.26.9 Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Auth-Token: gAAAAABitO_S41k5FPGDZS1jaXe338LQreBY-jmJnsl8A4JQ4jckb8vowQ05p1zQ5krsKZJTjZd7j9lt7hNzgbB8sQ2I5VhkKRw8dMCRBGxuUh4OhcQsKSo8d8rFqlMi79TSRi7a7rhbs5qNIQ32cbORB7PnW4imaK6h-95g1xARajYaRnDRW60 Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Id: None Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Domain-Name: None Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Identity-Status: Confirmed Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Is-Admin-Project: True Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Id: default Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Domain-Name: Default Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Id: c0a4f134a1b6433c8e3afade85914537 Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Project-Name: tempest-TestShelveInstance-1861256016 Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Role: member,reader Jun 23 23:01:52.053906 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Roles: member,reader Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0a4f134a1b6433c8e3afade85914537", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0a4f134a1b6433c8e3afade85914537"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0a4f134a1b6433c8e3afade85914537"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0a4f134a1b6433c8e3afade85914537"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}] Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant: tempest-TestShelveInstance-1861256016 Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Id: c0a4f134a1b6433c8e3afade85914537 Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-Tenant-Name: tempest-TestShelveInstance-1861256016 Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User: tempest-TestShelveInstance-1861256016-project Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Id: default Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Domain-Name: Default Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Id: f32ae651a9ef4937a74bf87b1689043f Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: X-User-Name: tempest-TestShelveInstance-1861256016-project Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: method: > Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: exception: Instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 could not be found. Jun 23 23:01:52.055795 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: action_args: {'id': '1133ea80-f77a-40c6-8f3b-a0701e0acd61'} Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: {{(pid=124724) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 could not be found. Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 23:01:52.057044 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 could not be found. Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 could not be found. Jun 23 23:01:52.058773 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: ERROR nova.api.openstack.wsgi Jun 23 23:01:52.060302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: DEBUG nova.api.openstack.wsgi [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Returning 404 to user: Instance 1133ea80-f77a-40c6-8f3b-a0701e0acd61 could not be found. {{(pid=124724) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 23:01:52.060302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO nova.api.openstack.requestlog [None req-4cae0755-cd2f-422c-9ade-c8722a3eb502 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61" status: 404 len: 111 microversion: 2.1 time: 0.029710 Jun 23 23:01:52.060302 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: [pid: 124724|app: 0|req: 636/1245] 10.222.0.33 () {58 vars in 1235 bytes} [Thu Jun 23 23:01:52 2022] GET /compute/v2.1/servers/1133ea80-f77a-40c6-8f3b-a0701e0acd61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 23:01:52.265972 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: DEBUG nova.api.openstack.wsgi [None req-dd398468-c50b-431d-858a-47ba46c690f7 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] Calling method '.version_select at 0x7fbbcad66940>' {{(pid=124725) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 23:01:52.269301 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dd398468-c50b-431d-858a-47ba46c690f7 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [cad3d791-aff8-4c54-9c3c-1aa3ac8db4e3] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 23 23:01:53.277469 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [None req-dd398468-c50b-431d-858a-47ba46c690f7 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] [cad3d791-aff8-4c54-9c3c-1aa3ac8db4e3] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 34708. Jun 23 23:01:53.387401 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO nova.api.openstack.requestlog [None req-dd398468-c50b-431d-858a-47ba46c690f7 tempest-TestShelveInstance-1861256016 tempest-TestShelveInstance-1861256016-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-818210174" status: 202 len: 0 microversion: 2.1 time: 1.125243 Jun 23 23:01:53.387984 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: [pid: 124725|app: 0|req: 610/1246] 10.222.0.33 () {58 vars in 1250 bytes} [Thu Jun 23 23:01:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-818210174 => generated 0 bytes in 1127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 23:01:57.011958 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 23:01:57.012489 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Thu Jun 23 23:01:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 23:02:08.630396 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 23:02:08.631028 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Thu Jun 23 23:02:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 23:04:15.197598 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 23:04:15.198297 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Thu Jun 23 23:04:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 23:04:17.662387 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 23:04:17.662943 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Thu Jun 23 23:04:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 23:05:17.029017 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 23:05:17.029803 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Thu Jun 23 23:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 23:05:27.968714 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 23:05:27.969406 dv-cinder-813229-11-iscsi devstack@n-api.service[124724]: Thu Jun 23 23:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 23:05:28.638888 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 23:05:28.639437 dv-cinder-813229-11-iscsi devstack@n-api.service[124725]: Thu Jun 23 23:05:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!